You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hbase.apache.org by "Tak-Lon (Stephen) Wu (Jira)" <ji...@apache.org> on 2021/06/02 17:41:00 UTC
[jira] [Commented] (HBASE-25921) Fix Wrong FileSystem when running
`filesystem` on non-HDFS storage
[ https://issues.apache.org/jira/browse/HBASE-25921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17355891#comment-17355891 ]
Tak-Lon (Stephen) Wu commented on HBASE-25921:
----------------------------------------------
it has been committed to master branch as [22458706ffc8973d6bd78ed325c138321cd19927|https://github.com/apache/hbase-operator-tools/commit/22458706ffc8973d6bd78ed325c138321cd19927]
> Fix Wrong FileSystem when running `filesystem` on non-HDFS storage
> ------------------------------------------------------------------
>
> Key: HBASE-25921
> URL: https://issues.apache.org/jira/browse/HBASE-25921
> Project: HBase
> Issue Type: Bug
> Components: hbase-operator-tools
> Affects Versions: 1.0.0, 1.1.0, 1.2.0
> Reporter: Tak-Lon (Stephen) Wu
> Assignee: Tak-Lon (Stephen) Wu
> Priority: Minor
> Fix For: 1.2.0
>
>
> recently we found a bug that when running {{hbck filesystem -f}} on a non-HDFS and caused {{Wrong FS}} error and cannot move forward.
> this change fix this problem and use {{FSUtils.getCurrentFileSystem}} to respect the root directory of what we set with {{hbase.rootdir}} in stead of just using {{fs.defaultFS}}
> e.g. this is one of the captured ERROR message
> {code}
> Exception in thread "main" java.lang.IllegalArgumentException: Wrong FS: s3://xyz/data/default/abc, expected: hdfs://xyz/
> at org.apache.hadoop.fs.FileSystem.checkPath(FileSystem.java:737)
> at org.apache.hadoop.hdfs.DistributedFileSystem.getPathName(DistributedFileSystem.java:233)
> at org.apache.hadoop.hdfs.DistributedFileSystem.listStatusInternal(DistributedFileSystem.java:1045)
> at org.apache.hadoop.hdfs.DistributedFileSystem.access$1000(DistributedFileSystem.java:131)
> at org.apache.hadoop.hdfs.DistributedFileSystem$24.doCall(DistributedFileSystem.java:1112)
> at org.apache.hadoop.hdfs.DistributedFileSystem$24.doCall(DistributedFileSystem.java:1109)
> at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81)
> at org.apache.hadoop.hdfs.DistributedFileSystem.listStatus(DistributedFileSystem.java:1119)
> at org.apache.hadoop.hbase.util.FSUtils.listStatusWithStatusFilter(FSUtils.java:1530)
> at org.apache.hbase.hbck1.HFileCorruptionChecker.checkTableDir(HFileCorruptionChecker.java:320)
> at org.apache.hbase.hbck1.HFileCorruptionChecker.checkTables(HFileCorruptionChecker.java:431)
> at org.apache.hbase.FileSystemFsck.fsck(FileSystemFsck.java:87)
> at org.apache.hbase.HBCK2.doCommandLine(HBCK2.java:721)
> at org.apache.hbase.HBCK2.run(HBCK2.java:631)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:76)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:90)
> at org.apache.hbase.HBCK2.main(HBCK2.java:865)
> {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)