You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hbase.apache.org by "guluo (Jira)" <ji...@apache.org> on 2024/03/07 15:36:00 UTC

[jira] [Created] (HBASE-28427) FNFE related to 'master:store' when moving archived hfiles to global archived dir

guluo created HBASE-28427:
-----------------------------

             Summary: FNFE related to 'master:store' when moving archived hfiles to global archived dir
                 Key: HBASE-28427
                 URL: https://issues.apache.org/jira/browse/HBASE-28427
             Project: HBase
          Issue Type: Improvement
          Components: master
         Environment: Centos7
hbase-4.0.0-alpha-1-SNAPSHOT
            Reporter: guluo


Sometimes we encounter the following log.
{code:java}
2024-02-26T18:11:34,934 WARN  [master:store-Store-Compactor] region.MasterRegionFlusherAndCompactor: Failed to move archived hfiles from file:/root/hbase-4.0.0-alpha-1-SNAPSHOT/tmp/hbase/MasterData/archive/data/master/store/1595e783b53d99cd5eef43b6debb2682/state to global dir file:/root/hbase-4.0.0-alpha-1-SNAPSHOT/tmp/hbase/archive/data/master/store/1595e783b53d99cd5eef43b6debb2682/statejava.io.FileNotFoundException: File file:/root/hbase-4.0.0-alpha-1-SNAPSHOT/tmp/hbase/MasterData/archive/data/master/store/1595e783b53d99cd5eef43b6debb2682/state does not exist        at org.apache.hadoop.fs.RawLocalFileSystem.listStatus(RawLocalFileSystem.java:733) ~[hadoop-common-3.3.5.jar:?]        at org.apache.hadoop.fs.FileSystem.listStatus(FileSystem.java:2045) ~[hadoop-common-3.3.5.jar:?]        at org.apache.hadoop.fs.FileSystem.listStatus(FileSystem.java:2089) ~[hadoop-common-3.3.5.jar:?]        at org.apache.hadoop.fs.ChecksumFileSystem.listStatus(ChecksumFileSystem.java:970) ~[hadoop-common-3.3.5.jar:?]        at org.apache.hadoop.hbase.master.region.MasterRegionUtils.moveFilesUnderDir(MasterRegionUtils.java:42) ~[hbase-server-4.0.0-alpha-1-SNAPSHOT.jar:4.0.0-alpha-1-SNAPSHOT]        at org.apache.hadoop.hbase.master.region.MasterRegionFlusherAndCompactor.moveHFileToGlobalArchiveDir(MasterRegionFlusherAndCompactor.java:145) ~[hbase-server-4.0.0-alpha-1-SNAPSHOT.jar:4.0.0-alpha-1-SNAPSHOT]        at org.apache.hadoop.hbase.master.region.MasterRegionFlusherAndCompactor.compact(MasterRegionFlusherAndCompactor.java:157) ~[hbase-server-4.0.0-alpha-1-SNAPSHOT.jar:4.0.0-alpha-1-SNAPSHOT]        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) ~[?:1.8.0_231]        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) ~[?:1.8.0_231]        at java.lang.Thread.run(Thread.java:748) ~[?:1.8.0_231] {code}
Analysis:
Against 'master:store', Archived hfiles would first be placed in \{hbase.rootdir}/MasterData/archive/ after compacting, and then moved to global archived dir.
'master:store' has 3 column families:proc,rs,state, if there is empty in one of column families,such as state, no files in this column families will be archived, and \{hbase.rootdir}/MasterData/archive/data/master/store/1595e783b53d99cd5eef43b6debb2682/state would do not exist.
Finally, we will get FileNotFoundException when moving these archived hfiles to global archived dir.
 
Although,Current code can avoid this effecting by catching Exception, However it is maybe better to check the dir exists before moving.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)