You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hbase.apache.org by "fulin wang (JIRA)" <ji...@apache.org> on 2012/04/25 11:28:02 UTC

[jira] [Created] (HBASE-5874) The HBase do not configure the 'fs.default.name' attribute, the hbck tool and Merge tool throw IllegalArgumentException.

fulin wang created HBASE-5874:
---------------------------------

             Summary: The HBase do not configure the 'fs.default.name' attribute, the hbck tool and Merge tool throw IllegalArgumentException.
                 Key: HBASE-5874
                 URL: https://issues.apache.org/jira/browse/HBASE-5874
             Project: HBase
          Issue Type: Bug
          Components: hbck
            Reporter: fulin wang


The HBase do not configure the 'fs.default.name' attribute, the hbck tool and Merge tool throw IllegalArgumentException.
the hbck tool and Merge tool, we should add 'fs.default.name' attriubte to the code.

hbck exception:
Exception in thread "main" java.lang.IllegalArgumentException: Wrong FS: hdfs://160.176.0.101:9000/hbase/.META./1028785192/.regioninfo, expected: file:///
	at org.apache.hadoop.fs.FileSystem.checkPath(FileSystem.java:412)
	at org.apache.hadoop.fs.RawLocalFileSystem.pathToFile(RawLocalFileSystem.java:59)
	at org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:382)
	at org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:285)
	at org.apache.hadoop.fs.ChecksumFileSystem$ChecksumFSInputChecker.<init>(ChecksumFileSystem.java:128)
	at org.apache.hadoop.fs.ChecksumFileSystem.open(ChecksumFileSystem.java:301)
	at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:489)
	at org.apache.hadoop.hbase.util.HBaseFsck.loadHdfsRegioninfo(HBaseFsck.java:565)
	at org.apache.hadoop.hbase.util.HBaseFsck.loadHdfsRegionInfos(HBaseFsck.java:596)
	at org.apache.hadoop.hbase.util.HBaseFsck.onlineConsistencyRepair(HBaseFsck.java:332)
	at org.apache.hadoop.hbase.util.HBaseFsck.onlineHbck(HBaseFsck.java:360)
	at org.apache.hadoop.hbase.util.HBaseFsck.main(HBaseFsck.java:2907)
    
Merge exception:  
[2012-05-05 10:48:24,830] [ERROR] [main] [org.apache.hadoop.hbase.util.Merge 381] exiting due to error
java.lang.IllegalArgumentException: Wrong FS: hdfs://160.176.0.101:9000/hbase/.META./1028785192/.regioninfo, expected: file:///
	at org.apache.hadoop.fs.FileSystem.checkPath(FileSystem.java:412)
	at org.apache.hadoop.fs.RawLocalFileSystem.pathToFile(RawLocalFileSystem.java:59)
	at org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:382)
	at org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:285)
	at org.apache.hadoop.fs.FileSystem.exists(FileSystem.java:823)
	at org.apache.hadoop.hbase.regionserver.HRegion.checkRegioninfoOnFilesystem(HRegion.java:415)
	at org.apache.hadoop.hbase.regionserver.HRegion.initialize(HRegion.java:340)
	at org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:2679)
	at org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:2665)
	at org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:2634)
	at org.apache.hadoop.hbase.util.MetaUtils.openMetaRegion(MetaUtils.java:276)
	at org.apache.hadoop.hbase.util.MetaUtils.scanMetaRegion(MetaUtils.java:261)
	at org.apache.hadoop.hbase.util.Merge.run(Merge.java:115)
	at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
	at org.apache.hadoop.hbase.util.Merge.main(Merge.java:379)

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (HBASE-5874) The HBase do not configure the 'fs.default.name' attribute, the hbck tool and Merge tool throw IllegalArgumentException.

Posted by "Zhihong Yu (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HBASE-5874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Zhihong Yu updated HBASE-5874:
------------------------------

    Hadoop Flags: Reviewed
          Status: Patch Available  (was: Open)
    
> The HBase do not configure the 'fs.default.name' attribute, the hbck tool and Merge tool throw IllegalArgumentException.
> ------------------------------------------------------------------------------------------------------------------------
>
>                 Key: HBASE-5874
>                 URL: https://issues.apache.org/jira/browse/HBASE-5874
>             Project: HBase
>          Issue Type: Bug
>          Components: hbck
>    Affects Versions: 0.90.6
>            Reporter: fulin wang
>         Attachments: HBASE-5874-0.90.patch, HBASE-5874-trunk.patch
>
>
> The HBase do not configure the 'fs.default.name' attribute, the hbck tool and Merge tool throw IllegalArgumentException.
> the hbck tool and Merge tool, we should add 'fs.default.name' attriubte to the code.
> hbck exception:
> Exception in thread "main" java.lang.IllegalArgumentException: Wrong FS: hdfs://160.176.0.101:9000/hbase/.META./1028785192/.regioninfo, expected: file:///
> 	at org.apache.hadoop.fs.FileSystem.checkPath(FileSystem.java:412)
> 	at org.apache.hadoop.fs.RawLocalFileSystem.pathToFile(RawLocalFileSystem.java:59)
> 	at org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:382)
> 	at org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:285)
> 	at org.apache.hadoop.fs.ChecksumFileSystem$ChecksumFSInputChecker.<init>(ChecksumFileSystem.java:128)
> 	at org.apache.hadoop.fs.ChecksumFileSystem.open(ChecksumFileSystem.java:301)
> 	at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:489)
> 	at org.apache.hadoop.hbase.util.HBaseFsck.loadHdfsRegioninfo(HBaseFsck.java:565)
> 	at org.apache.hadoop.hbase.util.HBaseFsck.loadHdfsRegionInfos(HBaseFsck.java:596)
> 	at org.apache.hadoop.hbase.util.HBaseFsck.onlineConsistencyRepair(HBaseFsck.java:332)
> 	at org.apache.hadoop.hbase.util.HBaseFsck.onlineHbck(HBaseFsck.java:360)
> 	at org.apache.hadoop.hbase.util.HBaseFsck.main(HBaseFsck.java:2907)
>     
> Merge exception:  
> [2012-05-05 10:48:24,830] [ERROR] [main] [org.apache.hadoop.hbase.util.Merge 381] exiting due to error
> java.lang.IllegalArgumentException: Wrong FS: hdfs://160.176.0.101:9000/hbase/.META./1028785192/.regioninfo, expected: file:///
> 	at org.apache.hadoop.fs.FileSystem.checkPath(FileSystem.java:412)
> 	at org.apache.hadoop.fs.RawLocalFileSystem.pathToFile(RawLocalFileSystem.java:59)
> 	at org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:382)
> 	at org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:285)
> 	at org.apache.hadoop.fs.FileSystem.exists(FileSystem.java:823)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.checkRegioninfoOnFilesystem(HRegion.java:415)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.initialize(HRegion.java:340)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:2679)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:2665)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:2634)
> 	at org.apache.hadoop.hbase.util.MetaUtils.openMetaRegion(MetaUtils.java:276)
> 	at org.apache.hadoop.hbase.util.MetaUtils.scanMetaRegion(MetaUtils.java:261)
> 	at org.apache.hadoop.hbase.util.Merge.run(Merge.java:115)
> 	at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
> 	at org.apache.hadoop.hbase.util.Merge.main(Merge.java:379)

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HBASE-5874) The HBase do not configure the 'fs.default.name' attribute, the hbck tool and Merge tool throw IllegalArgumentException.

Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HBASE-5874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13272042#comment-13272042 ] 

Hadoop QA commented on HBASE-5874:
----------------------------------

-1 overall.  Here are the results of testing the latest attachment 
  http://issues.apache.org/jira/secure/attachment/12526279/HBASE-5874-trunk-v3.patch
  against trunk revision .

    +1 @author.  The patch does not contain any @author tags.

    -1 tests included.  The patch doesn't appear to include any new or modified tests.
                        Please justify why no new tests are needed for this patch.
                        Also please list what manual steps were performed to verify this patch.

    +1 hadoop23.  The patch compiles against the hadoop 0.23.x profile.

    +1 javadoc.  The javadoc tool did not generate any warning messages.

    +1 javac.  The applied patch does not increase the total number of javac compiler warnings.

    +1 findbugs.  The patch does not introduce any new Findbugs (version 1.3.9) warnings.

    +1 release audit.  The applied patch does not increase the total number of release audit warnings.

     -1 core tests.  The patch failed these unit tests:
                       org.apache.hadoop.hbase.TestDrainingServer

Test results: https://builds.apache.org/job/PreCommit-HBASE-Build/1825//testReport/
Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/1825//artifact/trunk/patchprocess/newPatchFindbugsWarnings.html
Console output: https://builds.apache.org/job/PreCommit-HBASE-Build/1825//console

This message is automatically generated.
                
> The HBase do not configure the 'fs.default.name' attribute, the hbck tool and Merge tool throw IllegalArgumentException.
> ------------------------------------------------------------------------------------------------------------------------
>
>                 Key: HBASE-5874
>                 URL: https://issues.apache.org/jira/browse/HBASE-5874
>             Project: HBase
>          Issue Type: Bug
>          Components: hbck
>    Affects Versions: 0.90.6
>            Reporter: fulin wang
>            Assignee: fulin wang
>         Attachments: HBASE-5874-0.90-v2.patch, HBASE-5874-0.90.patch, HBASE-5874-trunk-v2.patch, HBASE-5874-trunk-v3.patch, HBASE-5874-trunk.patch
>
>
> The HBase do not configure the 'fs.default.name' attribute, the hbck tool and Merge tool throw IllegalArgumentException.
> the hbck tool and Merge tool, we should add 'fs.default.name' attriubte to the code.
> hbck exception:
> Exception in thread "main" java.lang.IllegalArgumentException: Wrong FS: hdfs://160.176.0.101:9000/hbase/.META./1028785192/.regioninfo, expected: file:///
> 	at org.apache.hadoop.fs.FileSystem.checkPath(FileSystem.java:412)
> 	at org.apache.hadoop.fs.RawLocalFileSystem.pathToFile(RawLocalFileSystem.java:59)
> 	at org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:382)
> 	at org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:285)
> 	at org.apache.hadoop.fs.ChecksumFileSystem$ChecksumFSInputChecker.<init>(ChecksumFileSystem.java:128)
> 	at org.apache.hadoop.fs.ChecksumFileSystem.open(ChecksumFileSystem.java:301)
> 	at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:489)
> 	at org.apache.hadoop.hbase.util.HBaseFsck.loadHdfsRegioninfo(HBaseFsck.java:565)
> 	at org.apache.hadoop.hbase.util.HBaseFsck.loadHdfsRegionInfos(HBaseFsck.java:596)
> 	at org.apache.hadoop.hbase.util.HBaseFsck.onlineConsistencyRepair(HBaseFsck.java:332)
> 	at org.apache.hadoop.hbase.util.HBaseFsck.onlineHbck(HBaseFsck.java:360)
> 	at org.apache.hadoop.hbase.util.HBaseFsck.main(HBaseFsck.java:2907)
>     
> Merge exception:  
> [2012-05-05 10:48:24,830] [ERROR] [main] [org.apache.hadoop.hbase.util.Merge 381] exiting due to error
> java.lang.IllegalArgumentException: Wrong FS: hdfs://160.176.0.101:9000/hbase/.META./1028785192/.regioninfo, expected: file:///
> 	at org.apache.hadoop.fs.FileSystem.checkPath(FileSystem.java:412)
> 	at org.apache.hadoop.fs.RawLocalFileSystem.pathToFile(RawLocalFileSystem.java:59)
> 	at org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:382)
> 	at org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:285)
> 	at org.apache.hadoop.fs.FileSystem.exists(FileSystem.java:823)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.checkRegioninfoOnFilesystem(HRegion.java:415)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.initialize(HRegion.java:340)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:2679)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:2665)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:2634)
> 	at org.apache.hadoop.hbase.util.MetaUtils.openMetaRegion(MetaUtils.java:276)
> 	at org.apache.hadoop.hbase.util.MetaUtils.scanMetaRegion(MetaUtils.java:261)
> 	at org.apache.hadoop.hbase.util.Merge.run(Merge.java:115)
> 	at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
> 	at org.apache.hadoop.hbase.util.Merge.main(Merge.java:379)

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (HBASE-5874) When 'fs.default.name' not configured, the hbck tool and Merge tool throw IllegalArgumentException.

Posted by "Jonathan Hsieh (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HBASE-5874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Jonathan Hsieh updated HBASE-5874:
----------------------------------

       Resolution: Fixed
    Fix Version/s: 0.92.3
                   0.94.1
                   0.96.0
                   0.90.7
           Status: Resolved  (was: Patch Available)

Sorry for the delay and thanks for the patch fulin!  

I committed to 0.90/0.92/0.94/0.96 with a minor tweak (change the <> to [] to show that the -Dfs.* args are optional).  
                
> When 'fs.default.name' not configured, the hbck tool and Merge tool throw IllegalArgumentException.
> ---------------------------------------------------------------------------------------------------
>
>                 Key: HBASE-5874
>                 URL: https://issues.apache.org/jira/browse/HBASE-5874
>             Project: HBase
>          Issue Type: Bug
>          Components: hbck
>    Affects Versions: 0.90.6
>            Reporter: fulin wang
>            Assignee: fulin wang
>             Fix For: 0.90.7, 0.96.0, 0.94.1, 0.92.3
>
>         Attachments: HBASE-5874-0.90-v2.patch, HBASE-5874-0.90.patch, HBASE-5874-trunk-v2.patch, HBASE-5874-trunk-v3.patch, HBASE-5874-trunk.patch
>
>
> The HBase do not configure the 'fs.default.name' attribute, the hbck tool and Merge tool throw IllegalArgumentException.
> the hbck tool and Merge tool, we should add 'fs.default.name' attriubte to the code.
> hbck exception:
> Exception in thread "main" java.lang.IllegalArgumentException: Wrong FS: hdfs://160.176.0.101:9000/hbase/.META./1028785192/.regioninfo, expected: file:///
> 	at org.apache.hadoop.fs.FileSystem.checkPath(FileSystem.java:412)
> 	at org.apache.hadoop.fs.RawLocalFileSystem.pathToFile(RawLocalFileSystem.java:59)
> 	at org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:382)
> 	at org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:285)
> 	at org.apache.hadoop.fs.ChecksumFileSystem$ChecksumFSInputChecker.<init>(ChecksumFileSystem.java:128)
> 	at org.apache.hadoop.fs.ChecksumFileSystem.open(ChecksumFileSystem.java:301)
> 	at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:489)
> 	at org.apache.hadoop.hbase.util.HBaseFsck.loadHdfsRegioninfo(HBaseFsck.java:565)
> 	at org.apache.hadoop.hbase.util.HBaseFsck.loadHdfsRegionInfos(HBaseFsck.java:596)
> 	at org.apache.hadoop.hbase.util.HBaseFsck.onlineConsistencyRepair(HBaseFsck.java:332)
> 	at org.apache.hadoop.hbase.util.HBaseFsck.onlineHbck(HBaseFsck.java:360)
> 	at org.apache.hadoop.hbase.util.HBaseFsck.main(HBaseFsck.java:2907)
>     
> Merge exception:  
> [2012-05-05 10:48:24,830] [ERROR] [main] [org.apache.hadoop.hbase.util.Merge 381] exiting due to error
> java.lang.IllegalArgumentException: Wrong FS: hdfs://160.176.0.101:9000/hbase/.META./1028785192/.regioninfo, expected: file:///
> 	at org.apache.hadoop.fs.FileSystem.checkPath(FileSystem.java:412)
> 	at org.apache.hadoop.fs.RawLocalFileSystem.pathToFile(RawLocalFileSystem.java:59)
> 	at org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:382)
> 	at org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:285)
> 	at org.apache.hadoop.fs.FileSystem.exists(FileSystem.java:823)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.checkRegioninfoOnFilesystem(HRegion.java:415)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.initialize(HRegion.java:340)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:2679)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:2665)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:2634)
> 	at org.apache.hadoop.hbase.util.MetaUtils.openMetaRegion(MetaUtils.java:276)
> 	at org.apache.hadoop.hbase.util.MetaUtils.scanMetaRegion(MetaUtils.java:261)
> 	at org.apache.hadoop.hbase.util.Merge.run(Merge.java:115)
> 	at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
> 	at org.apache.hadoop.hbase.util.Merge.main(Merge.java:379)

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HBASE-5874) The HBase do not configure the 'fs.default.name' attribute, the hbck tool and Merge tool throw IllegalArgumentException.

Posted by "fulin wang (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HBASE-5874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13271229#comment-13271229 ] 

fulin wang commented on HBASE-5874:
-----------------------------------

Thank you for attention.

1. the hbck tool, I think it need to add 'fs.default.name' attribute.
2. the merge tool, I will modify help, because it is error now.
                
> The HBase do not configure the 'fs.default.name' attribute, the hbck tool and Merge tool throw IllegalArgumentException.
> ------------------------------------------------------------------------------------------------------------------------
>
>                 Key: HBASE-5874
>                 URL: https://issues.apache.org/jira/browse/HBASE-5874
>             Project: HBase
>          Issue Type: Bug
>          Components: hbck
>    Affects Versions: 0.90.6
>            Reporter: fulin wang
>            Assignee: fulin wang
>         Attachments: HBASE-5874-0.90.patch, HBASE-5874-trunk.patch
>
>
> The HBase do not configure the 'fs.default.name' attribute, the hbck tool and Merge tool throw IllegalArgumentException.
> the hbck tool and Merge tool, we should add 'fs.default.name' attriubte to the code.
> hbck exception:
> Exception in thread "main" java.lang.IllegalArgumentException: Wrong FS: hdfs://160.176.0.101:9000/hbase/.META./1028785192/.regioninfo, expected: file:///
> 	at org.apache.hadoop.fs.FileSystem.checkPath(FileSystem.java:412)
> 	at org.apache.hadoop.fs.RawLocalFileSystem.pathToFile(RawLocalFileSystem.java:59)
> 	at org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:382)
> 	at org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:285)
> 	at org.apache.hadoop.fs.ChecksumFileSystem$ChecksumFSInputChecker.<init>(ChecksumFileSystem.java:128)
> 	at org.apache.hadoop.fs.ChecksumFileSystem.open(ChecksumFileSystem.java:301)
> 	at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:489)
> 	at org.apache.hadoop.hbase.util.HBaseFsck.loadHdfsRegioninfo(HBaseFsck.java:565)
> 	at org.apache.hadoop.hbase.util.HBaseFsck.loadHdfsRegionInfos(HBaseFsck.java:596)
> 	at org.apache.hadoop.hbase.util.HBaseFsck.onlineConsistencyRepair(HBaseFsck.java:332)
> 	at org.apache.hadoop.hbase.util.HBaseFsck.onlineHbck(HBaseFsck.java:360)
> 	at org.apache.hadoop.hbase.util.HBaseFsck.main(HBaseFsck.java:2907)
>     
> Merge exception:  
> [2012-05-05 10:48:24,830] [ERROR] [main] [org.apache.hadoop.hbase.util.Merge 381] exiting due to error
> java.lang.IllegalArgumentException: Wrong FS: hdfs://160.176.0.101:9000/hbase/.META./1028785192/.regioninfo, expected: file:///
> 	at org.apache.hadoop.fs.FileSystem.checkPath(FileSystem.java:412)
> 	at org.apache.hadoop.fs.RawLocalFileSystem.pathToFile(RawLocalFileSystem.java:59)
> 	at org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:382)
> 	at org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:285)
> 	at org.apache.hadoop.fs.FileSystem.exists(FileSystem.java:823)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.checkRegioninfoOnFilesystem(HRegion.java:415)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.initialize(HRegion.java:340)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:2679)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:2665)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:2634)
> 	at org.apache.hadoop.hbase.util.MetaUtils.openMetaRegion(MetaUtils.java:276)
> 	at org.apache.hadoop.hbase.util.MetaUtils.scanMetaRegion(MetaUtils.java:261)
> 	at org.apache.hadoop.hbase.util.Merge.run(Merge.java:115)
> 	at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
> 	at org.apache.hadoop.hbase.util.Merge.main(Merge.java:379)

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (HBASE-5874) The HBase do not configure the 'fs.default.name' attribute, the hbck tool and Merge tool throw IllegalArgumentException.

Posted by "fulin wang (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HBASE-5874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

fulin wang updated HBASE-5874:
------------------------------

    Attachment: HBASE-5874-trunk-v2.patch
                HBASE-5874-0.90-v2.patch

The TestHBaseFsck and TestMergeTool have tesed.
                
> The HBase do not configure the 'fs.default.name' attribute, the hbck tool and Merge tool throw IllegalArgumentException.
> ------------------------------------------------------------------------------------------------------------------------
>
>                 Key: HBASE-5874
>                 URL: https://issues.apache.org/jira/browse/HBASE-5874
>             Project: HBase
>          Issue Type: Bug
>          Components: hbck
>    Affects Versions: 0.90.6
>            Reporter: fulin wang
>            Assignee: fulin wang
>         Attachments: HBASE-5874-0.90-v2.patch, HBASE-5874-0.90.patch, HBASE-5874-trunk-v2.patch, HBASE-5874-trunk.patch
>
>
> The HBase do not configure the 'fs.default.name' attribute, the hbck tool and Merge tool throw IllegalArgumentException.
> the hbck tool and Merge tool, we should add 'fs.default.name' attriubte to the code.
> hbck exception:
> Exception in thread "main" java.lang.IllegalArgumentException: Wrong FS: hdfs://160.176.0.101:9000/hbase/.META./1028785192/.regioninfo, expected: file:///
> 	at org.apache.hadoop.fs.FileSystem.checkPath(FileSystem.java:412)
> 	at org.apache.hadoop.fs.RawLocalFileSystem.pathToFile(RawLocalFileSystem.java:59)
> 	at org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:382)
> 	at org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:285)
> 	at org.apache.hadoop.fs.ChecksumFileSystem$ChecksumFSInputChecker.<init>(ChecksumFileSystem.java:128)
> 	at org.apache.hadoop.fs.ChecksumFileSystem.open(ChecksumFileSystem.java:301)
> 	at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:489)
> 	at org.apache.hadoop.hbase.util.HBaseFsck.loadHdfsRegioninfo(HBaseFsck.java:565)
> 	at org.apache.hadoop.hbase.util.HBaseFsck.loadHdfsRegionInfos(HBaseFsck.java:596)
> 	at org.apache.hadoop.hbase.util.HBaseFsck.onlineConsistencyRepair(HBaseFsck.java:332)
> 	at org.apache.hadoop.hbase.util.HBaseFsck.onlineHbck(HBaseFsck.java:360)
> 	at org.apache.hadoop.hbase.util.HBaseFsck.main(HBaseFsck.java:2907)
>     
> Merge exception:  
> [2012-05-05 10:48:24,830] [ERROR] [main] [org.apache.hadoop.hbase.util.Merge 381] exiting due to error
> java.lang.IllegalArgumentException: Wrong FS: hdfs://160.176.0.101:9000/hbase/.META./1028785192/.regioninfo, expected: file:///
> 	at org.apache.hadoop.fs.FileSystem.checkPath(FileSystem.java:412)
> 	at org.apache.hadoop.fs.RawLocalFileSystem.pathToFile(RawLocalFileSystem.java:59)
> 	at org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:382)
> 	at org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:285)
> 	at org.apache.hadoop.fs.FileSystem.exists(FileSystem.java:823)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.checkRegioninfoOnFilesystem(HRegion.java:415)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.initialize(HRegion.java:340)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:2679)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:2665)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:2634)
> 	at org.apache.hadoop.hbase.util.MetaUtils.openMetaRegion(MetaUtils.java:276)
> 	at org.apache.hadoop.hbase.util.MetaUtils.scanMetaRegion(MetaUtils.java:261)
> 	at org.apache.hadoop.hbase.util.Merge.run(Merge.java:115)
> 	at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
> 	at org.apache.hadoop.hbase.util.Merge.main(Merge.java:379)

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HBASE-5874) The HBase do not configure the 'fs.default.name' attribute, the hbck tool and Merge tool throw IllegalArgumentException.

Posted by "fulin wang (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HBASE-5874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13264207#comment-13264207 ] 

fulin wang commented on HBASE-5874:
-----------------------------------

I have tested, It pass.
There is some reason for add 'fs.default.name' attribute.
1) It make hbck tool and Merge tool easy to use.
2) We should supported old version, you can reference the MasterFileSystem class.
I suggested to add the attribute.
                
> The HBase do not configure the 'fs.default.name' attribute, the hbck tool and Merge tool throw IllegalArgumentException.
> ------------------------------------------------------------------------------------------------------------------------
>
>                 Key: HBASE-5874
>                 URL: https://issues.apache.org/jira/browse/HBASE-5874
>             Project: HBase
>          Issue Type: Bug
>          Components: hbck
>    Affects Versions: 0.90.6
>            Reporter: fulin wang
>            Assignee: fulin wang
>         Attachments: HBASE-5874-0.90.patch, HBASE-5874-trunk.patch
>
>
> The HBase do not configure the 'fs.default.name' attribute, the hbck tool and Merge tool throw IllegalArgumentException.
> the hbck tool and Merge tool, we should add 'fs.default.name' attriubte to the code.
> hbck exception:
> Exception in thread "main" java.lang.IllegalArgumentException: Wrong FS: hdfs://160.176.0.101:9000/hbase/.META./1028785192/.regioninfo, expected: file:///
> 	at org.apache.hadoop.fs.FileSystem.checkPath(FileSystem.java:412)
> 	at org.apache.hadoop.fs.RawLocalFileSystem.pathToFile(RawLocalFileSystem.java:59)
> 	at org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:382)
> 	at org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:285)
> 	at org.apache.hadoop.fs.ChecksumFileSystem$ChecksumFSInputChecker.<init>(ChecksumFileSystem.java:128)
> 	at org.apache.hadoop.fs.ChecksumFileSystem.open(ChecksumFileSystem.java:301)
> 	at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:489)
> 	at org.apache.hadoop.hbase.util.HBaseFsck.loadHdfsRegioninfo(HBaseFsck.java:565)
> 	at org.apache.hadoop.hbase.util.HBaseFsck.loadHdfsRegionInfos(HBaseFsck.java:596)
> 	at org.apache.hadoop.hbase.util.HBaseFsck.onlineConsistencyRepair(HBaseFsck.java:332)
> 	at org.apache.hadoop.hbase.util.HBaseFsck.onlineHbck(HBaseFsck.java:360)
> 	at org.apache.hadoop.hbase.util.HBaseFsck.main(HBaseFsck.java:2907)
>     
> Merge exception:  
> [2012-05-05 10:48:24,830] [ERROR] [main] [org.apache.hadoop.hbase.util.Merge 381] exiting due to error
> java.lang.IllegalArgumentException: Wrong FS: hdfs://160.176.0.101:9000/hbase/.META./1028785192/.regioninfo, expected: file:///
> 	at org.apache.hadoop.fs.FileSystem.checkPath(FileSystem.java:412)
> 	at org.apache.hadoop.fs.RawLocalFileSystem.pathToFile(RawLocalFileSystem.java:59)
> 	at org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:382)
> 	at org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:285)
> 	at org.apache.hadoop.fs.FileSystem.exists(FileSystem.java:823)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.checkRegioninfoOnFilesystem(HRegion.java:415)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.initialize(HRegion.java:340)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:2679)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:2665)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:2634)
> 	at org.apache.hadoop.hbase.util.MetaUtils.openMetaRegion(MetaUtils.java:276)
> 	at org.apache.hadoop.hbase.util.MetaUtils.scanMetaRegion(MetaUtils.java:261)
> 	at org.apache.hadoop.hbase.util.Merge.run(Merge.java:115)
> 	at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
> 	at org.apache.hadoop.hbase.util.Merge.main(Merge.java:379)

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HBASE-5874) The HBase do not configure the 'fs.default.name' attribute, the hbck tool and Merge tool throw IllegalArgumentException.

Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HBASE-5874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13263334#comment-13263334 ] 

Hadoop QA commented on HBASE-5874:
----------------------------------

-1 overall.  Here are the results of testing the latest attachment 
  http://issues.apache.org/jira/secure/attachment/12524806/HBASE-5874-trunk.patch
  against trunk revision .

    +1 @author.  The patch does not contain any @author tags.

    -1 tests included.  The patch doesn't appear to include any new or modified tests.
                        Please justify why no new tests are needed for this patch.
                        Also please list what manual steps were performed to verify this patch.

    +1 javadoc.  The javadoc tool did not generate any warning messages.

    +1 javac.  The applied patch does not increase the total number of javac compiler warnings.

    -1 findbugs.  The patch appears to introduce 2 new Findbugs (version 1.3.9) warnings.

    +1 release audit.  The applied patch does not increase the total number of release audit warnings.

    +1 core tests.  The patch passed unit tests in .

Test results: https://builds.apache.org/job/PreCommit-HBASE-Build/1665//testReport/
Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/1665//artifact/trunk/patchprocess/newPatchFindbugsWarnings.html
Console output: https://builds.apache.org/job/PreCommit-HBASE-Build/1665//console

This message is automatically generated.
                
> The HBase do not configure the 'fs.default.name' attribute, the hbck tool and Merge tool throw IllegalArgumentException.
> ------------------------------------------------------------------------------------------------------------------------
>
>                 Key: HBASE-5874
>                 URL: https://issues.apache.org/jira/browse/HBASE-5874
>             Project: HBase
>          Issue Type: Bug
>          Components: hbck
>    Affects Versions: 0.90.6
>            Reporter: fulin wang
>         Attachments: HBASE-5874-0.90.patch, HBASE-5874-trunk.patch
>
>
> The HBase do not configure the 'fs.default.name' attribute, the hbck tool and Merge tool throw IllegalArgumentException.
> the hbck tool and Merge tool, we should add 'fs.default.name' attriubte to the code.
> hbck exception:
> Exception in thread "main" java.lang.IllegalArgumentException: Wrong FS: hdfs://160.176.0.101:9000/hbase/.META./1028785192/.regioninfo, expected: file:///
> 	at org.apache.hadoop.fs.FileSystem.checkPath(FileSystem.java:412)
> 	at org.apache.hadoop.fs.RawLocalFileSystem.pathToFile(RawLocalFileSystem.java:59)
> 	at org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:382)
> 	at org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:285)
> 	at org.apache.hadoop.fs.ChecksumFileSystem$ChecksumFSInputChecker.<init>(ChecksumFileSystem.java:128)
> 	at org.apache.hadoop.fs.ChecksumFileSystem.open(ChecksumFileSystem.java:301)
> 	at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:489)
> 	at org.apache.hadoop.hbase.util.HBaseFsck.loadHdfsRegioninfo(HBaseFsck.java:565)
> 	at org.apache.hadoop.hbase.util.HBaseFsck.loadHdfsRegionInfos(HBaseFsck.java:596)
> 	at org.apache.hadoop.hbase.util.HBaseFsck.onlineConsistencyRepair(HBaseFsck.java:332)
> 	at org.apache.hadoop.hbase.util.HBaseFsck.onlineHbck(HBaseFsck.java:360)
> 	at org.apache.hadoop.hbase.util.HBaseFsck.main(HBaseFsck.java:2907)
>     
> Merge exception:  
> [2012-05-05 10:48:24,830] [ERROR] [main] [org.apache.hadoop.hbase.util.Merge 381] exiting due to error
> java.lang.IllegalArgumentException: Wrong FS: hdfs://160.176.0.101:9000/hbase/.META./1028785192/.regioninfo, expected: file:///
> 	at org.apache.hadoop.fs.FileSystem.checkPath(FileSystem.java:412)
> 	at org.apache.hadoop.fs.RawLocalFileSystem.pathToFile(RawLocalFileSystem.java:59)
> 	at org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:382)
> 	at org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:285)
> 	at org.apache.hadoop.fs.FileSystem.exists(FileSystem.java:823)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.checkRegioninfoOnFilesystem(HRegion.java:415)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.initialize(HRegion.java:340)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:2679)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:2665)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:2634)
> 	at org.apache.hadoop.hbase.util.MetaUtils.openMetaRegion(MetaUtils.java:276)
> 	at org.apache.hadoop.hbase.util.MetaUtils.scanMetaRegion(MetaUtils.java:261)
> 	at org.apache.hadoop.hbase.util.Merge.run(Merge.java:115)
> 	at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
> 	at org.apache.hadoop.hbase.util.Merge.main(Merge.java:379)

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HBASE-5874) The HBase do not configure the 'fs.default.name' attribute, the hbck tool and Merge tool throw IllegalArgumentException.

Posted by "Jonathan Hsieh (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HBASE-5874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13271609#comment-13271609 ] 

Jonathan Hsieh commented on HBASE-5874:
---------------------------------------

Fulin, 

The latest version still doesn't address the issue I brought up:

Look at what should be fs.defaultFS here: http://hadoop.apache.org/common/docs/current/core-default.html

I think the code I'm concerned about should be something like this:
{code}
    Path hbasedir = new Path(conf.get(HConstants.HBASE_DIR));
    URI defaultFs = hbasedir.getFileSystem(conf).getUri();
    conf.set("fs.defaultFS", defaultFs.toString());     // for hadoop 0.21+
    conf.set("fs.default.name", defaultFs.toString());  // for hadoop 0.20
{code}

for Merge, it might be good to make the -D option look optional or have a place holder for <-Doptions> where you put the example and add some lines further down with a quick mention of  -Dfs.defaultFs for hadoop 0.21+ or -Dfs.default.name for 0.20.

Thanks,
Jon.
                
> The HBase do not configure the 'fs.default.name' attribute, the hbck tool and Merge tool throw IllegalArgumentException.
> ------------------------------------------------------------------------------------------------------------------------
>
>                 Key: HBASE-5874
>                 URL: https://issues.apache.org/jira/browse/HBASE-5874
>             Project: HBase
>          Issue Type: Bug
>          Components: hbck
>    Affects Versions: 0.90.6
>            Reporter: fulin wang
>            Assignee: fulin wang
>         Attachments: HBASE-5874-0.90-v2.patch, HBASE-5874-0.90.patch, HBASE-5874-trunk-v2.patch, HBASE-5874-trunk.patch
>
>
> The HBase do not configure the 'fs.default.name' attribute, the hbck tool and Merge tool throw IllegalArgumentException.
> the hbck tool and Merge tool, we should add 'fs.default.name' attriubte to the code.
> hbck exception:
> Exception in thread "main" java.lang.IllegalArgumentException: Wrong FS: hdfs://160.176.0.101:9000/hbase/.META./1028785192/.regioninfo, expected: file:///
> 	at org.apache.hadoop.fs.FileSystem.checkPath(FileSystem.java:412)
> 	at org.apache.hadoop.fs.RawLocalFileSystem.pathToFile(RawLocalFileSystem.java:59)
> 	at org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:382)
> 	at org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:285)
> 	at org.apache.hadoop.fs.ChecksumFileSystem$ChecksumFSInputChecker.<init>(ChecksumFileSystem.java:128)
> 	at org.apache.hadoop.fs.ChecksumFileSystem.open(ChecksumFileSystem.java:301)
> 	at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:489)
> 	at org.apache.hadoop.hbase.util.HBaseFsck.loadHdfsRegioninfo(HBaseFsck.java:565)
> 	at org.apache.hadoop.hbase.util.HBaseFsck.loadHdfsRegionInfos(HBaseFsck.java:596)
> 	at org.apache.hadoop.hbase.util.HBaseFsck.onlineConsistencyRepair(HBaseFsck.java:332)
> 	at org.apache.hadoop.hbase.util.HBaseFsck.onlineHbck(HBaseFsck.java:360)
> 	at org.apache.hadoop.hbase.util.HBaseFsck.main(HBaseFsck.java:2907)
>     
> Merge exception:  
> [2012-05-05 10:48:24,830] [ERROR] [main] [org.apache.hadoop.hbase.util.Merge 381] exiting due to error
> java.lang.IllegalArgumentException: Wrong FS: hdfs://160.176.0.101:9000/hbase/.META./1028785192/.regioninfo, expected: file:///
> 	at org.apache.hadoop.fs.FileSystem.checkPath(FileSystem.java:412)
> 	at org.apache.hadoop.fs.RawLocalFileSystem.pathToFile(RawLocalFileSystem.java:59)
> 	at org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:382)
> 	at org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:285)
> 	at org.apache.hadoop.fs.FileSystem.exists(FileSystem.java:823)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.checkRegioninfoOnFilesystem(HRegion.java:415)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.initialize(HRegion.java:340)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:2679)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:2665)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:2634)
> 	at org.apache.hadoop.hbase.util.MetaUtils.openMetaRegion(MetaUtils.java:276)
> 	at org.apache.hadoop.hbase.util.MetaUtils.scanMetaRegion(MetaUtils.java:261)
> 	at org.apache.hadoop.hbase.util.Merge.run(Merge.java:115)
> 	at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
> 	at org.apache.hadoop.hbase.util.Merge.main(Merge.java:379)

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HBASE-5874) The HBase do not configure the 'fs.default.name' attribute, the hbck tool and Merge tool throw IllegalArgumentException.

Posted by "fulin wang (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HBASE-5874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13266292#comment-13266292 ] 

fulin wang commented on HBASE-5874:
-----------------------------------

First the community version think this is issue, it need to make other branch patch.

                
> The HBase do not configure the 'fs.default.name' attribute, the hbck tool and Merge tool throw IllegalArgumentException.
> ------------------------------------------------------------------------------------------------------------------------
>
>                 Key: HBASE-5874
>                 URL: https://issues.apache.org/jira/browse/HBASE-5874
>             Project: HBase
>          Issue Type: Bug
>          Components: hbck
>    Affects Versions: 0.90.6
>            Reporter: fulin wang
>            Assignee: fulin wang
>         Attachments: HBASE-5874-0.90.patch, HBASE-5874-trunk.patch
>
>
> The HBase do not configure the 'fs.default.name' attribute, the hbck tool and Merge tool throw IllegalArgumentException.
> the hbck tool and Merge tool, we should add 'fs.default.name' attriubte to the code.
> hbck exception:
> Exception in thread "main" java.lang.IllegalArgumentException: Wrong FS: hdfs://160.176.0.101:9000/hbase/.META./1028785192/.regioninfo, expected: file:///
> 	at org.apache.hadoop.fs.FileSystem.checkPath(FileSystem.java:412)
> 	at org.apache.hadoop.fs.RawLocalFileSystem.pathToFile(RawLocalFileSystem.java:59)
> 	at org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:382)
> 	at org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:285)
> 	at org.apache.hadoop.fs.ChecksumFileSystem$ChecksumFSInputChecker.<init>(ChecksumFileSystem.java:128)
> 	at org.apache.hadoop.fs.ChecksumFileSystem.open(ChecksumFileSystem.java:301)
> 	at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:489)
> 	at org.apache.hadoop.hbase.util.HBaseFsck.loadHdfsRegioninfo(HBaseFsck.java:565)
> 	at org.apache.hadoop.hbase.util.HBaseFsck.loadHdfsRegionInfos(HBaseFsck.java:596)
> 	at org.apache.hadoop.hbase.util.HBaseFsck.onlineConsistencyRepair(HBaseFsck.java:332)
> 	at org.apache.hadoop.hbase.util.HBaseFsck.onlineHbck(HBaseFsck.java:360)
> 	at org.apache.hadoop.hbase.util.HBaseFsck.main(HBaseFsck.java:2907)
>     
> Merge exception:  
> [2012-05-05 10:48:24,830] [ERROR] [main] [org.apache.hadoop.hbase.util.Merge 381] exiting due to error
> java.lang.IllegalArgumentException: Wrong FS: hdfs://160.176.0.101:9000/hbase/.META./1028785192/.regioninfo, expected: file:///
> 	at org.apache.hadoop.fs.FileSystem.checkPath(FileSystem.java:412)
> 	at org.apache.hadoop.fs.RawLocalFileSystem.pathToFile(RawLocalFileSystem.java:59)
> 	at org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:382)
> 	at org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:285)
> 	at org.apache.hadoop.fs.FileSystem.exists(FileSystem.java:823)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.checkRegioninfoOnFilesystem(HRegion.java:415)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.initialize(HRegion.java:340)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:2679)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:2665)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:2634)
> 	at org.apache.hadoop.hbase.util.MetaUtils.openMetaRegion(MetaUtils.java:276)
> 	at org.apache.hadoop.hbase.util.MetaUtils.scanMetaRegion(MetaUtils.java:261)
> 	at org.apache.hadoop.hbase.util.Merge.run(Merge.java:115)
> 	at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
> 	at org.apache.hadoop.hbase.util.Merge.main(Merge.java:379)

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (HBASE-5874) When 'fs.default.name' not configured, the hbck tool and Merge tool throw IllegalArgumentException.

Posted by "Jonathan Hsieh (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HBASE-5874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Jonathan Hsieh updated HBASE-5874:
----------------------------------

    Summary: When 'fs.default.name' not configured, the hbck tool and Merge tool throw IllegalArgumentException.  (was: The HBase do not configure the 'fs.default.name' attribute, the hbck tool and Merge tool throw IllegalArgumentException.)
    
> When 'fs.default.name' not configured, the hbck tool and Merge tool throw IllegalArgumentException.
> ---------------------------------------------------------------------------------------------------
>
>                 Key: HBASE-5874
>                 URL: https://issues.apache.org/jira/browse/HBASE-5874
>             Project: HBase
>          Issue Type: Bug
>          Components: hbck
>    Affects Versions: 0.90.6
>            Reporter: fulin wang
>            Assignee: fulin wang
>         Attachments: HBASE-5874-0.90-v2.patch, HBASE-5874-0.90.patch, HBASE-5874-trunk-v2.patch, HBASE-5874-trunk-v3.patch, HBASE-5874-trunk.patch
>
>
> The HBase do not configure the 'fs.default.name' attribute, the hbck tool and Merge tool throw IllegalArgumentException.
> the hbck tool and Merge tool, we should add 'fs.default.name' attriubte to the code.
> hbck exception:
> Exception in thread "main" java.lang.IllegalArgumentException: Wrong FS: hdfs://160.176.0.101:9000/hbase/.META./1028785192/.regioninfo, expected: file:///
> 	at org.apache.hadoop.fs.FileSystem.checkPath(FileSystem.java:412)
> 	at org.apache.hadoop.fs.RawLocalFileSystem.pathToFile(RawLocalFileSystem.java:59)
> 	at org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:382)
> 	at org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:285)
> 	at org.apache.hadoop.fs.ChecksumFileSystem$ChecksumFSInputChecker.<init>(ChecksumFileSystem.java:128)
> 	at org.apache.hadoop.fs.ChecksumFileSystem.open(ChecksumFileSystem.java:301)
> 	at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:489)
> 	at org.apache.hadoop.hbase.util.HBaseFsck.loadHdfsRegioninfo(HBaseFsck.java:565)
> 	at org.apache.hadoop.hbase.util.HBaseFsck.loadHdfsRegionInfos(HBaseFsck.java:596)
> 	at org.apache.hadoop.hbase.util.HBaseFsck.onlineConsistencyRepair(HBaseFsck.java:332)
> 	at org.apache.hadoop.hbase.util.HBaseFsck.onlineHbck(HBaseFsck.java:360)
> 	at org.apache.hadoop.hbase.util.HBaseFsck.main(HBaseFsck.java:2907)
>     
> Merge exception:  
> [2012-05-05 10:48:24,830] [ERROR] [main] [org.apache.hadoop.hbase.util.Merge 381] exiting due to error
> java.lang.IllegalArgumentException: Wrong FS: hdfs://160.176.0.101:9000/hbase/.META./1028785192/.regioninfo, expected: file:///
> 	at org.apache.hadoop.fs.FileSystem.checkPath(FileSystem.java:412)
> 	at org.apache.hadoop.fs.RawLocalFileSystem.pathToFile(RawLocalFileSystem.java:59)
> 	at org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:382)
> 	at org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:285)
> 	at org.apache.hadoop.fs.FileSystem.exists(FileSystem.java:823)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.checkRegioninfoOnFilesystem(HRegion.java:415)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.initialize(HRegion.java:340)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:2679)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:2665)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:2634)
> 	at org.apache.hadoop.hbase.util.MetaUtils.openMetaRegion(MetaUtils.java:276)
> 	at org.apache.hadoop.hbase.util.MetaUtils.scanMetaRegion(MetaUtils.java:261)
> 	at org.apache.hadoop.hbase.util.Merge.run(Merge.java:115)
> 	at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
> 	at org.apache.hadoop.hbase.util.Merge.main(Merge.java:379)

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HBASE-5874) The HBase do not configure the 'fs.default.name' attribute, the hbck tool and Merge tool throw IllegalArgumentException.

Posted by "Zhihong Yu (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HBASE-5874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13263335#comment-13263335 ] 

Zhihong Yu commented on HBASE-5874:
-----------------------------------

+1 on patch.
                
> The HBase do not configure the 'fs.default.name' attribute, the hbck tool and Merge tool throw IllegalArgumentException.
> ------------------------------------------------------------------------------------------------------------------------
>
>                 Key: HBASE-5874
>                 URL: https://issues.apache.org/jira/browse/HBASE-5874
>             Project: HBase
>          Issue Type: Bug
>          Components: hbck
>    Affects Versions: 0.90.6
>            Reporter: fulin wang
>         Attachments: HBASE-5874-0.90.patch, HBASE-5874-trunk.patch
>
>
> The HBase do not configure the 'fs.default.name' attribute, the hbck tool and Merge tool throw IllegalArgumentException.
> the hbck tool and Merge tool, we should add 'fs.default.name' attriubte to the code.
> hbck exception:
> Exception in thread "main" java.lang.IllegalArgumentException: Wrong FS: hdfs://160.176.0.101:9000/hbase/.META./1028785192/.regioninfo, expected: file:///
> 	at org.apache.hadoop.fs.FileSystem.checkPath(FileSystem.java:412)
> 	at org.apache.hadoop.fs.RawLocalFileSystem.pathToFile(RawLocalFileSystem.java:59)
> 	at org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:382)
> 	at org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:285)
> 	at org.apache.hadoop.fs.ChecksumFileSystem$ChecksumFSInputChecker.<init>(ChecksumFileSystem.java:128)
> 	at org.apache.hadoop.fs.ChecksumFileSystem.open(ChecksumFileSystem.java:301)
> 	at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:489)
> 	at org.apache.hadoop.hbase.util.HBaseFsck.loadHdfsRegioninfo(HBaseFsck.java:565)
> 	at org.apache.hadoop.hbase.util.HBaseFsck.loadHdfsRegionInfos(HBaseFsck.java:596)
> 	at org.apache.hadoop.hbase.util.HBaseFsck.onlineConsistencyRepair(HBaseFsck.java:332)
> 	at org.apache.hadoop.hbase.util.HBaseFsck.onlineHbck(HBaseFsck.java:360)
> 	at org.apache.hadoop.hbase.util.HBaseFsck.main(HBaseFsck.java:2907)
>     
> Merge exception:  
> [2012-05-05 10:48:24,830] [ERROR] [main] [org.apache.hadoop.hbase.util.Merge 381] exiting due to error
> java.lang.IllegalArgumentException: Wrong FS: hdfs://160.176.0.101:9000/hbase/.META./1028785192/.regioninfo, expected: file:///
> 	at org.apache.hadoop.fs.FileSystem.checkPath(FileSystem.java:412)
> 	at org.apache.hadoop.fs.RawLocalFileSystem.pathToFile(RawLocalFileSystem.java:59)
> 	at org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:382)
> 	at org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:285)
> 	at org.apache.hadoop.fs.FileSystem.exists(FileSystem.java:823)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.checkRegioninfoOnFilesystem(HRegion.java:415)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.initialize(HRegion.java:340)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:2679)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:2665)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:2634)
> 	at org.apache.hadoop.hbase.util.MetaUtils.openMetaRegion(MetaUtils.java:276)
> 	at org.apache.hadoop.hbase.util.MetaUtils.scanMetaRegion(MetaUtils.java:261)
> 	at org.apache.hadoop.hbase.util.Merge.run(Merge.java:115)
> 	at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
> 	at org.apache.hadoop.hbase.util.Merge.main(Merge.java:379)

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HBASE-5874) When 'fs.default.name' not configured, the hbck tool and Merge tool throw IllegalArgumentException.

Posted by "Hudson (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HBASE-5874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13288510#comment-13288510 ] 

Hudson commented on HBASE-5874:
-------------------------------

Integrated in HBase-TRUNK #2983 (See [https://builds.apache.org/job/HBase-TRUNK/2983/])
    HBASE-5874 When 'fs.default.name' not configured, the hbck tool and Merge tool throws IllegalArgumentException (fulin wang) (Revision 1345902)

     Result = FAILURE
jmhsieh : 
Files : 
* /hbase/trunk/hbase-server/src/main/java/org/apache/hadoop/hbase/util/HBaseFsck.java
* /hbase/trunk/hbase-server/src/main/java/org/apache/hadoop/hbase/util/Merge.java

                
> When 'fs.default.name' not configured, the hbck tool and Merge tool throw IllegalArgumentException.
> ---------------------------------------------------------------------------------------------------
>
>                 Key: HBASE-5874
>                 URL: https://issues.apache.org/jira/browse/HBASE-5874
>             Project: HBase
>          Issue Type: Bug
>          Components: hbck
>    Affects Versions: 0.90.6
>            Reporter: fulin wang
>            Assignee: fulin wang
>             Fix For: 0.90.7, 0.96.0, 0.94.1, 0.92.3
>
>         Attachments: HBASE-5874-0.90-v2.patch, HBASE-5874-0.90.patch, HBASE-5874-trunk-v2.patch, HBASE-5874-trunk-v3.patch, HBASE-5874-trunk.patch
>
>
> The HBase do not configure the 'fs.default.name' attribute, the hbck tool and Merge tool throw IllegalArgumentException.
> the hbck tool and Merge tool, we should add 'fs.default.name' attriubte to the code.
> hbck exception:
> Exception in thread "main" java.lang.IllegalArgumentException: Wrong FS: hdfs://160.176.0.101:9000/hbase/.META./1028785192/.regioninfo, expected: file:///
> 	at org.apache.hadoop.fs.FileSystem.checkPath(FileSystem.java:412)
> 	at org.apache.hadoop.fs.RawLocalFileSystem.pathToFile(RawLocalFileSystem.java:59)
> 	at org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:382)
> 	at org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:285)
> 	at org.apache.hadoop.fs.ChecksumFileSystem$ChecksumFSInputChecker.<init>(ChecksumFileSystem.java:128)
> 	at org.apache.hadoop.fs.ChecksumFileSystem.open(ChecksumFileSystem.java:301)
> 	at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:489)
> 	at org.apache.hadoop.hbase.util.HBaseFsck.loadHdfsRegioninfo(HBaseFsck.java:565)
> 	at org.apache.hadoop.hbase.util.HBaseFsck.loadHdfsRegionInfos(HBaseFsck.java:596)
> 	at org.apache.hadoop.hbase.util.HBaseFsck.onlineConsistencyRepair(HBaseFsck.java:332)
> 	at org.apache.hadoop.hbase.util.HBaseFsck.onlineHbck(HBaseFsck.java:360)
> 	at org.apache.hadoop.hbase.util.HBaseFsck.main(HBaseFsck.java:2907)
>     
> Merge exception:  
> [2012-05-05 10:48:24,830] [ERROR] [main] [org.apache.hadoop.hbase.util.Merge 381] exiting due to error
> java.lang.IllegalArgumentException: Wrong FS: hdfs://160.176.0.101:9000/hbase/.META./1028785192/.regioninfo, expected: file:///
> 	at org.apache.hadoop.fs.FileSystem.checkPath(FileSystem.java:412)
> 	at org.apache.hadoop.fs.RawLocalFileSystem.pathToFile(RawLocalFileSystem.java:59)
> 	at org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:382)
> 	at org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:285)
> 	at org.apache.hadoop.fs.FileSystem.exists(FileSystem.java:823)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.checkRegioninfoOnFilesystem(HRegion.java:415)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.initialize(HRegion.java:340)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:2679)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:2665)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:2634)
> 	at org.apache.hadoop.hbase.util.MetaUtils.openMetaRegion(MetaUtils.java:276)
> 	at org.apache.hadoop.hbase.util.MetaUtils.scanMetaRegion(MetaUtils.java:261)
> 	at org.apache.hadoop.hbase.util.Merge.run(Merge.java:115)
> 	at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
> 	at org.apache.hadoop.hbase.util.Merge.main(Merge.java:379)

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HBASE-5874) When 'fs.default.name' not configured, the hbck tool and Merge tool throw IllegalArgumentException.

Posted by "Hudson (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HBASE-5874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13288850#comment-13288850 ] 

Hudson commented on HBASE-5874:
-------------------------------

Integrated in HBase-0.92-security #110 (See [https://builds.apache.org/job/HBase-0.92-security/110/])
    HBASE-5874 When 'fs.default.name' not configured, the hbck tool and Merge tool throws IllegalArgumentException (fulin wang) (Revision 1345905)

     Result = FAILURE
jmhsieh : 
Files : 
* /hbase/branches/0.92/CHANGES.txt
* /hbase/branches/0.92/src/main/java/org/apache/hadoop/hbase/util/HBaseFsck.java
* /hbase/branches/0.92/src/main/java/org/apache/hadoop/hbase/util/Merge.java

                
> When 'fs.default.name' not configured, the hbck tool and Merge tool throw IllegalArgumentException.
> ---------------------------------------------------------------------------------------------------
>
>                 Key: HBASE-5874
>                 URL: https://issues.apache.org/jira/browse/HBASE-5874
>             Project: HBase
>          Issue Type: Bug
>          Components: hbck
>    Affects Versions: 0.90.6
>            Reporter: fulin wang
>            Assignee: fulin wang
>             Fix For: 0.90.7, 0.96.0, 0.94.1, 0.92.3
>
>         Attachments: HBASE-5874-0.90-v2.patch, HBASE-5874-0.90.patch, HBASE-5874-trunk-v2.patch, HBASE-5874-trunk-v3.patch, HBASE-5874-trunk.patch
>
>
> The HBase do not configure the 'fs.default.name' attribute, the hbck tool and Merge tool throw IllegalArgumentException.
> the hbck tool and Merge tool, we should add 'fs.default.name' attriubte to the code.
> hbck exception:
> Exception in thread "main" java.lang.IllegalArgumentException: Wrong FS: hdfs://160.176.0.101:9000/hbase/.META./1028785192/.regioninfo, expected: file:///
> 	at org.apache.hadoop.fs.FileSystem.checkPath(FileSystem.java:412)
> 	at org.apache.hadoop.fs.RawLocalFileSystem.pathToFile(RawLocalFileSystem.java:59)
> 	at org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:382)
> 	at org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:285)
> 	at org.apache.hadoop.fs.ChecksumFileSystem$ChecksumFSInputChecker.<init>(ChecksumFileSystem.java:128)
> 	at org.apache.hadoop.fs.ChecksumFileSystem.open(ChecksumFileSystem.java:301)
> 	at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:489)
> 	at org.apache.hadoop.hbase.util.HBaseFsck.loadHdfsRegioninfo(HBaseFsck.java:565)
> 	at org.apache.hadoop.hbase.util.HBaseFsck.loadHdfsRegionInfos(HBaseFsck.java:596)
> 	at org.apache.hadoop.hbase.util.HBaseFsck.onlineConsistencyRepair(HBaseFsck.java:332)
> 	at org.apache.hadoop.hbase.util.HBaseFsck.onlineHbck(HBaseFsck.java:360)
> 	at org.apache.hadoop.hbase.util.HBaseFsck.main(HBaseFsck.java:2907)
>     
> Merge exception:  
> [2012-05-05 10:48:24,830] [ERROR] [main] [org.apache.hadoop.hbase.util.Merge 381] exiting due to error
> java.lang.IllegalArgumentException: Wrong FS: hdfs://160.176.0.101:9000/hbase/.META./1028785192/.regioninfo, expected: file:///
> 	at org.apache.hadoop.fs.FileSystem.checkPath(FileSystem.java:412)
> 	at org.apache.hadoop.fs.RawLocalFileSystem.pathToFile(RawLocalFileSystem.java:59)
> 	at org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:382)
> 	at org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:285)
> 	at org.apache.hadoop.fs.FileSystem.exists(FileSystem.java:823)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.checkRegioninfoOnFilesystem(HRegion.java:415)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.initialize(HRegion.java:340)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:2679)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:2665)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:2634)
> 	at org.apache.hadoop.hbase.util.MetaUtils.openMetaRegion(MetaUtils.java:276)
> 	at org.apache.hadoop.hbase.util.MetaUtils.scanMetaRegion(MetaUtils.java:261)
> 	at org.apache.hadoop.hbase.util.Merge.run(Merge.java:115)
> 	at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
> 	at org.apache.hadoop.hbase.util.Merge.main(Merge.java:379)

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HBASE-5874) When 'fs.default.name' not configured, the hbck tool and Merge tool throw IllegalArgumentException.

Posted by "Hudson (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HBASE-5874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13288497#comment-13288497 ] 

Hudson commented on HBASE-5874:
-------------------------------

Integrated in HBase-TRUNK-on-Hadoop-2.0.0 #39 (See [https://builds.apache.org/job/HBase-TRUNK-on-Hadoop-2.0.0/39/])
    HBASE-5874 When 'fs.default.name' not configured, the hbck tool and Merge tool throws IllegalArgumentException (fulin wang) (Revision 1345902)

     Result = FAILURE
jmhsieh : 
Files : 
* /hbase/trunk/hbase-server/src/main/java/org/apache/hadoop/hbase/util/HBaseFsck.java
* /hbase/trunk/hbase-server/src/main/java/org/apache/hadoop/hbase/util/Merge.java

                
> When 'fs.default.name' not configured, the hbck tool and Merge tool throw IllegalArgumentException.
> ---------------------------------------------------------------------------------------------------
>
>                 Key: HBASE-5874
>                 URL: https://issues.apache.org/jira/browse/HBASE-5874
>             Project: HBase
>          Issue Type: Bug
>          Components: hbck
>    Affects Versions: 0.90.6
>            Reporter: fulin wang
>            Assignee: fulin wang
>             Fix For: 0.90.7, 0.96.0, 0.94.1, 0.92.3
>
>         Attachments: HBASE-5874-0.90-v2.patch, HBASE-5874-0.90.patch, HBASE-5874-trunk-v2.patch, HBASE-5874-trunk-v3.patch, HBASE-5874-trunk.patch
>
>
> The HBase do not configure the 'fs.default.name' attribute, the hbck tool and Merge tool throw IllegalArgumentException.
> the hbck tool and Merge tool, we should add 'fs.default.name' attriubte to the code.
> hbck exception:
> Exception in thread "main" java.lang.IllegalArgumentException: Wrong FS: hdfs://160.176.0.101:9000/hbase/.META./1028785192/.regioninfo, expected: file:///
> 	at org.apache.hadoop.fs.FileSystem.checkPath(FileSystem.java:412)
> 	at org.apache.hadoop.fs.RawLocalFileSystem.pathToFile(RawLocalFileSystem.java:59)
> 	at org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:382)
> 	at org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:285)
> 	at org.apache.hadoop.fs.ChecksumFileSystem$ChecksumFSInputChecker.<init>(ChecksumFileSystem.java:128)
> 	at org.apache.hadoop.fs.ChecksumFileSystem.open(ChecksumFileSystem.java:301)
> 	at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:489)
> 	at org.apache.hadoop.hbase.util.HBaseFsck.loadHdfsRegioninfo(HBaseFsck.java:565)
> 	at org.apache.hadoop.hbase.util.HBaseFsck.loadHdfsRegionInfos(HBaseFsck.java:596)
> 	at org.apache.hadoop.hbase.util.HBaseFsck.onlineConsistencyRepair(HBaseFsck.java:332)
> 	at org.apache.hadoop.hbase.util.HBaseFsck.onlineHbck(HBaseFsck.java:360)
> 	at org.apache.hadoop.hbase.util.HBaseFsck.main(HBaseFsck.java:2907)
>     
> Merge exception:  
> [2012-05-05 10:48:24,830] [ERROR] [main] [org.apache.hadoop.hbase.util.Merge 381] exiting due to error
> java.lang.IllegalArgumentException: Wrong FS: hdfs://160.176.0.101:9000/hbase/.META./1028785192/.regioninfo, expected: file:///
> 	at org.apache.hadoop.fs.FileSystem.checkPath(FileSystem.java:412)
> 	at org.apache.hadoop.fs.RawLocalFileSystem.pathToFile(RawLocalFileSystem.java:59)
> 	at org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:382)
> 	at org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:285)
> 	at org.apache.hadoop.fs.FileSystem.exists(FileSystem.java:823)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.checkRegioninfoOnFilesystem(HRegion.java:415)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.initialize(HRegion.java:340)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:2679)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:2665)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:2634)
> 	at org.apache.hadoop.hbase.util.MetaUtils.openMetaRegion(MetaUtils.java:276)
> 	at org.apache.hadoop.hbase.util.MetaUtils.scanMetaRegion(MetaUtils.java:261)
> 	at org.apache.hadoop.hbase.util.Merge.run(Merge.java:115)
> 	at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
> 	at org.apache.hadoop.hbase.util.Merge.main(Merge.java:379)

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (HBASE-5874) The HBase do not configure the 'fs.default.name' attribute, the hbck tool and Merge tool throw IllegalArgumentException.

Posted by "fulin wang (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HBASE-5874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

fulin wang updated HBASE-5874:
------------------------------

    Attachment: HBASE-5874-trunk.patch

The TestHBaseFsck and TestMergeTool test case of trunk, I have tested.
                
> The HBase do not configure the 'fs.default.name' attribute, the hbck tool and Merge tool throw IllegalArgumentException.
> ------------------------------------------------------------------------------------------------------------------------
>
>                 Key: HBASE-5874
>                 URL: https://issues.apache.org/jira/browse/HBASE-5874
>             Project: HBase
>          Issue Type: Bug
>          Components: hbck
>    Affects Versions: 0.90.6
>            Reporter: fulin wang
>         Attachments: HBASE-5874-0.90.patch, HBASE-5874-trunk.patch
>
>
> The HBase do not configure the 'fs.default.name' attribute, the hbck tool and Merge tool throw IllegalArgumentException.
> the hbck tool and Merge tool, we should add 'fs.default.name' attriubte to the code.
> hbck exception:
> Exception in thread "main" java.lang.IllegalArgumentException: Wrong FS: hdfs://160.176.0.101:9000/hbase/.META./1028785192/.regioninfo, expected: file:///
> 	at org.apache.hadoop.fs.FileSystem.checkPath(FileSystem.java:412)
> 	at org.apache.hadoop.fs.RawLocalFileSystem.pathToFile(RawLocalFileSystem.java:59)
> 	at org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:382)
> 	at org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:285)
> 	at org.apache.hadoop.fs.ChecksumFileSystem$ChecksumFSInputChecker.<init>(ChecksumFileSystem.java:128)
> 	at org.apache.hadoop.fs.ChecksumFileSystem.open(ChecksumFileSystem.java:301)
> 	at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:489)
> 	at org.apache.hadoop.hbase.util.HBaseFsck.loadHdfsRegioninfo(HBaseFsck.java:565)
> 	at org.apache.hadoop.hbase.util.HBaseFsck.loadHdfsRegionInfos(HBaseFsck.java:596)
> 	at org.apache.hadoop.hbase.util.HBaseFsck.onlineConsistencyRepair(HBaseFsck.java:332)
> 	at org.apache.hadoop.hbase.util.HBaseFsck.onlineHbck(HBaseFsck.java:360)
> 	at org.apache.hadoop.hbase.util.HBaseFsck.main(HBaseFsck.java:2907)
>     
> Merge exception:  
> [2012-05-05 10:48:24,830] [ERROR] [main] [org.apache.hadoop.hbase.util.Merge 381] exiting due to error
> java.lang.IllegalArgumentException: Wrong FS: hdfs://160.176.0.101:9000/hbase/.META./1028785192/.regioninfo, expected: file:///
> 	at org.apache.hadoop.fs.FileSystem.checkPath(FileSystem.java:412)
> 	at org.apache.hadoop.fs.RawLocalFileSystem.pathToFile(RawLocalFileSystem.java:59)
> 	at org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:382)
> 	at org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:285)
> 	at org.apache.hadoop.fs.FileSystem.exists(FileSystem.java:823)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.checkRegioninfoOnFilesystem(HRegion.java:415)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.initialize(HRegion.java:340)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:2679)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:2665)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:2634)
> 	at org.apache.hadoop.hbase.util.MetaUtils.openMetaRegion(MetaUtils.java:276)
> 	at org.apache.hadoop.hbase.util.MetaUtils.scanMetaRegion(MetaUtils.java:261)
> 	at org.apache.hadoop.hbase.util.Merge.run(Merge.java:115)
> 	at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
> 	at org.apache.hadoop.hbase.util.Merge.main(Merge.java:379)

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (HBASE-5874) The HBase do not configure the 'fs.default.name' attribute, the hbck tool and Merge tool throw IllegalArgumentException.

Posted by "fulin wang (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HBASE-5874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

fulin wang updated HBASE-5874:
------------------------------

    Attachment: HBASE-5874-0.90.patch

Tests Errors  Failures Skipped Success Rate Time 
16 0 0 0 100% 243.016 

Running org.apache.hadoop.hbase.util.TestMergeTool
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 49.765 sec

Results :

Tests run: 1, Failures: 0, Errors: 0, Skipped: 0



                
> The HBase do not configure the 'fs.default.name' attribute, the hbck tool and Merge tool throw IllegalArgumentException.
> ------------------------------------------------------------------------------------------------------------------------
>
>                 Key: HBASE-5874
>                 URL: https://issues.apache.org/jira/browse/HBASE-5874
>             Project: HBase
>          Issue Type: Bug
>          Components: hbck
>    Affects Versions: 0.90.6
>            Reporter: fulin wang
>         Attachments: HBASE-5874-0.90.patch
>
>
> The HBase do not configure the 'fs.default.name' attribute, the hbck tool and Merge tool throw IllegalArgumentException.
> the hbck tool and Merge tool, we should add 'fs.default.name' attriubte to the code.
> hbck exception:
> Exception in thread "main" java.lang.IllegalArgumentException: Wrong FS: hdfs://160.176.0.101:9000/hbase/.META./1028785192/.regioninfo, expected: file:///
> 	at org.apache.hadoop.fs.FileSystem.checkPath(FileSystem.java:412)
> 	at org.apache.hadoop.fs.RawLocalFileSystem.pathToFile(RawLocalFileSystem.java:59)
> 	at org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:382)
> 	at org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:285)
> 	at org.apache.hadoop.fs.ChecksumFileSystem$ChecksumFSInputChecker.<init>(ChecksumFileSystem.java:128)
> 	at org.apache.hadoop.fs.ChecksumFileSystem.open(ChecksumFileSystem.java:301)
> 	at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:489)
> 	at org.apache.hadoop.hbase.util.HBaseFsck.loadHdfsRegioninfo(HBaseFsck.java:565)
> 	at org.apache.hadoop.hbase.util.HBaseFsck.loadHdfsRegionInfos(HBaseFsck.java:596)
> 	at org.apache.hadoop.hbase.util.HBaseFsck.onlineConsistencyRepair(HBaseFsck.java:332)
> 	at org.apache.hadoop.hbase.util.HBaseFsck.onlineHbck(HBaseFsck.java:360)
> 	at org.apache.hadoop.hbase.util.HBaseFsck.main(HBaseFsck.java:2907)
>     
> Merge exception:  
> [2012-05-05 10:48:24,830] [ERROR] [main] [org.apache.hadoop.hbase.util.Merge 381] exiting due to error
> java.lang.IllegalArgumentException: Wrong FS: hdfs://160.176.0.101:9000/hbase/.META./1028785192/.regioninfo, expected: file:///
> 	at org.apache.hadoop.fs.FileSystem.checkPath(FileSystem.java:412)
> 	at org.apache.hadoop.fs.RawLocalFileSystem.pathToFile(RawLocalFileSystem.java:59)
> 	at org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:382)
> 	at org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:285)
> 	at org.apache.hadoop.fs.FileSystem.exists(FileSystem.java:823)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.checkRegioninfoOnFilesystem(HRegion.java:415)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.initialize(HRegion.java:340)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:2679)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:2665)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:2634)
> 	at org.apache.hadoop.hbase.util.MetaUtils.openMetaRegion(MetaUtils.java:276)
> 	at org.apache.hadoop.hbase.util.MetaUtils.scanMetaRegion(MetaUtils.java:261)
> 	at org.apache.hadoop.hbase.util.Merge.run(Merge.java:115)
> 	at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
> 	at org.apache.hadoop.hbase.util.Merge.main(Merge.java:379)

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (HBASE-5874) The HBase do not configure the 'fs.default.name' attribute, the hbck tool and Merge tool throw IllegalArgumentException.

Posted by "fulin wang (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HBASE-5874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

fulin wang updated HBASE-5874:
------------------------------

    Affects Version/s: 0.90.6
    
> The HBase do not configure the 'fs.default.name' attribute, the hbck tool and Merge tool throw IllegalArgumentException.
> ------------------------------------------------------------------------------------------------------------------------
>
>                 Key: HBASE-5874
>                 URL: https://issues.apache.org/jira/browse/HBASE-5874
>             Project: HBase
>          Issue Type: Bug
>          Components: hbck
>    Affects Versions: 0.90.6
>            Reporter: fulin wang
>
> The HBase do not configure the 'fs.default.name' attribute, the hbck tool and Merge tool throw IllegalArgumentException.
> the hbck tool and Merge tool, we should add 'fs.default.name' attriubte to the code.
> hbck exception:
> Exception in thread "main" java.lang.IllegalArgumentException: Wrong FS: hdfs://160.176.0.101:9000/hbase/.META./1028785192/.regioninfo, expected: file:///
> 	at org.apache.hadoop.fs.FileSystem.checkPath(FileSystem.java:412)
> 	at org.apache.hadoop.fs.RawLocalFileSystem.pathToFile(RawLocalFileSystem.java:59)
> 	at org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:382)
> 	at org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:285)
> 	at org.apache.hadoop.fs.ChecksumFileSystem$ChecksumFSInputChecker.<init>(ChecksumFileSystem.java:128)
> 	at org.apache.hadoop.fs.ChecksumFileSystem.open(ChecksumFileSystem.java:301)
> 	at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:489)
> 	at org.apache.hadoop.hbase.util.HBaseFsck.loadHdfsRegioninfo(HBaseFsck.java:565)
> 	at org.apache.hadoop.hbase.util.HBaseFsck.loadHdfsRegionInfos(HBaseFsck.java:596)
> 	at org.apache.hadoop.hbase.util.HBaseFsck.onlineConsistencyRepair(HBaseFsck.java:332)
> 	at org.apache.hadoop.hbase.util.HBaseFsck.onlineHbck(HBaseFsck.java:360)
> 	at org.apache.hadoop.hbase.util.HBaseFsck.main(HBaseFsck.java:2907)
>     
> Merge exception:  
> [2012-05-05 10:48:24,830] [ERROR] [main] [org.apache.hadoop.hbase.util.Merge 381] exiting due to error
> java.lang.IllegalArgumentException: Wrong FS: hdfs://160.176.0.101:9000/hbase/.META./1028785192/.regioninfo, expected: file:///
> 	at org.apache.hadoop.fs.FileSystem.checkPath(FileSystem.java:412)
> 	at org.apache.hadoop.fs.RawLocalFileSystem.pathToFile(RawLocalFileSystem.java:59)
> 	at org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:382)
> 	at org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:285)
> 	at org.apache.hadoop.fs.FileSystem.exists(FileSystem.java:823)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.checkRegioninfoOnFilesystem(HRegion.java:415)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.initialize(HRegion.java:340)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:2679)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:2665)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:2634)
> 	at org.apache.hadoop.hbase.util.MetaUtils.openMetaRegion(MetaUtils.java:276)
> 	at org.apache.hadoop.hbase.util.MetaUtils.scanMetaRegion(MetaUtils.java:261)
> 	at org.apache.hadoop.hbase.util.Merge.run(Merge.java:115)
> 	at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
> 	at org.apache.hadoop.hbase.util.Merge.main(Merge.java:379)

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Assigned] (HBASE-5874) The HBase do not configure the 'fs.default.name' attribute, the hbck tool and Merge tool throw IllegalArgumentException.

Posted by "Jonathan Hsieh (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HBASE-5874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Jonathan Hsieh reassigned HBASE-5874:
-------------------------------------

    Assignee: fulin wang

Hey fulin, in the future you can set yourself as the assignee to an issue if you are working on it.
                
> The HBase do not configure the 'fs.default.name' attribute, the hbck tool and Merge tool throw IllegalArgumentException.
> ------------------------------------------------------------------------------------------------------------------------
>
>                 Key: HBASE-5874
>                 URL: https://issues.apache.org/jira/browse/HBASE-5874
>             Project: HBase
>          Issue Type: Bug
>          Components: hbck
>    Affects Versions: 0.90.6
>            Reporter: fulin wang
>            Assignee: fulin wang
>         Attachments: HBASE-5874-0.90.patch, HBASE-5874-trunk.patch
>
>
> The HBase do not configure the 'fs.default.name' attribute, the hbck tool and Merge tool throw IllegalArgumentException.
> the hbck tool and Merge tool, we should add 'fs.default.name' attriubte to the code.
> hbck exception:
> Exception in thread "main" java.lang.IllegalArgumentException: Wrong FS: hdfs://160.176.0.101:9000/hbase/.META./1028785192/.regioninfo, expected: file:///
> 	at org.apache.hadoop.fs.FileSystem.checkPath(FileSystem.java:412)
> 	at org.apache.hadoop.fs.RawLocalFileSystem.pathToFile(RawLocalFileSystem.java:59)
> 	at org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:382)
> 	at org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:285)
> 	at org.apache.hadoop.fs.ChecksumFileSystem$ChecksumFSInputChecker.<init>(ChecksumFileSystem.java:128)
> 	at org.apache.hadoop.fs.ChecksumFileSystem.open(ChecksumFileSystem.java:301)
> 	at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:489)
> 	at org.apache.hadoop.hbase.util.HBaseFsck.loadHdfsRegioninfo(HBaseFsck.java:565)
> 	at org.apache.hadoop.hbase.util.HBaseFsck.loadHdfsRegionInfos(HBaseFsck.java:596)
> 	at org.apache.hadoop.hbase.util.HBaseFsck.onlineConsistencyRepair(HBaseFsck.java:332)
> 	at org.apache.hadoop.hbase.util.HBaseFsck.onlineHbck(HBaseFsck.java:360)
> 	at org.apache.hadoop.hbase.util.HBaseFsck.main(HBaseFsck.java:2907)
>     
> Merge exception:  
> [2012-05-05 10:48:24,830] [ERROR] [main] [org.apache.hadoop.hbase.util.Merge 381] exiting due to error
> java.lang.IllegalArgumentException: Wrong FS: hdfs://160.176.0.101:9000/hbase/.META./1028785192/.regioninfo, expected: file:///
> 	at org.apache.hadoop.fs.FileSystem.checkPath(FileSystem.java:412)
> 	at org.apache.hadoop.fs.RawLocalFileSystem.pathToFile(RawLocalFileSystem.java:59)
> 	at org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:382)
> 	at org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:285)
> 	at org.apache.hadoop.fs.FileSystem.exists(FileSystem.java:823)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.checkRegioninfoOnFilesystem(HRegion.java:415)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.initialize(HRegion.java:340)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:2679)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:2665)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:2634)
> 	at org.apache.hadoop.hbase.util.MetaUtils.openMetaRegion(MetaUtils.java:276)
> 	at org.apache.hadoop.hbase.util.MetaUtils.scanMetaRegion(MetaUtils.java:261)
> 	at org.apache.hadoop.hbase.util.Merge.run(Merge.java:115)
> 	at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
> 	at org.apache.hadoop.hbase.util.Merge.main(Merge.java:379)

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HBASE-5874) When 'fs.default.name' not configured, the hbck tool and Merge tool throw IllegalArgumentException.

Posted by "Hudson (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HBASE-5874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13289036#comment-13289036 ] 

Hudson commented on HBASE-5874:
-------------------------------

Integrated in HBase-0.94-security #34 (See [https://builds.apache.org/job/HBase-0.94-security/34/])
    HBASE-5874 When 'fs.default.name' not configured, the hbck tool and Merge tool throws IllegalArgumentException (fulin wang) (Revision 1345903)

     Result = SUCCESS
jmhsieh : 
Files : 
* /hbase/branches/0.94/src/main/java/org/apache/hadoop/hbase/util/HBaseFsck.java
* /hbase/branches/0.94/src/main/java/org/apache/hadoop/hbase/util/Merge.java

                
> When 'fs.default.name' not configured, the hbck tool and Merge tool throw IllegalArgumentException.
> ---------------------------------------------------------------------------------------------------
>
>                 Key: HBASE-5874
>                 URL: https://issues.apache.org/jira/browse/HBASE-5874
>             Project: HBase
>          Issue Type: Bug
>          Components: hbck
>    Affects Versions: 0.90.6
>            Reporter: fulin wang
>            Assignee: fulin wang
>             Fix For: 0.90.7, 0.96.0, 0.94.1, 0.92.3
>
>         Attachments: HBASE-5874-0.90-v2.patch, HBASE-5874-0.90.patch, HBASE-5874-trunk-v2.patch, HBASE-5874-trunk-v3.patch, HBASE-5874-trunk.patch
>
>
> The HBase do not configure the 'fs.default.name' attribute, the hbck tool and Merge tool throw IllegalArgumentException.
> the hbck tool and Merge tool, we should add 'fs.default.name' attriubte to the code.
> hbck exception:
> Exception in thread "main" java.lang.IllegalArgumentException: Wrong FS: hdfs://160.176.0.101:9000/hbase/.META./1028785192/.regioninfo, expected: file:///
> 	at org.apache.hadoop.fs.FileSystem.checkPath(FileSystem.java:412)
> 	at org.apache.hadoop.fs.RawLocalFileSystem.pathToFile(RawLocalFileSystem.java:59)
> 	at org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:382)
> 	at org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:285)
> 	at org.apache.hadoop.fs.ChecksumFileSystem$ChecksumFSInputChecker.<init>(ChecksumFileSystem.java:128)
> 	at org.apache.hadoop.fs.ChecksumFileSystem.open(ChecksumFileSystem.java:301)
> 	at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:489)
> 	at org.apache.hadoop.hbase.util.HBaseFsck.loadHdfsRegioninfo(HBaseFsck.java:565)
> 	at org.apache.hadoop.hbase.util.HBaseFsck.loadHdfsRegionInfos(HBaseFsck.java:596)
> 	at org.apache.hadoop.hbase.util.HBaseFsck.onlineConsistencyRepair(HBaseFsck.java:332)
> 	at org.apache.hadoop.hbase.util.HBaseFsck.onlineHbck(HBaseFsck.java:360)
> 	at org.apache.hadoop.hbase.util.HBaseFsck.main(HBaseFsck.java:2907)
>     
> Merge exception:  
> [2012-05-05 10:48:24,830] [ERROR] [main] [org.apache.hadoop.hbase.util.Merge 381] exiting due to error
> java.lang.IllegalArgumentException: Wrong FS: hdfs://160.176.0.101:9000/hbase/.META./1028785192/.regioninfo, expected: file:///
> 	at org.apache.hadoop.fs.FileSystem.checkPath(FileSystem.java:412)
> 	at org.apache.hadoop.fs.RawLocalFileSystem.pathToFile(RawLocalFileSystem.java:59)
> 	at org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:382)
> 	at org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:285)
> 	at org.apache.hadoop.fs.FileSystem.exists(FileSystem.java:823)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.checkRegioninfoOnFilesystem(HRegion.java:415)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.initialize(HRegion.java:340)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:2679)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:2665)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:2634)
> 	at org.apache.hadoop.hbase.util.MetaUtils.openMetaRegion(MetaUtils.java:276)
> 	at org.apache.hadoop.hbase.util.MetaUtils.scanMetaRegion(MetaUtils.java:261)
> 	at org.apache.hadoop.hbase.util.Merge.run(Merge.java:115)
> 	at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
> 	at org.apache.hadoop.hbase.util.Merge.main(Merge.java:379)

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HBASE-5874) When 'fs.default.name' not configured, the hbck tool and Merge tool throw IllegalArgumentException.

Posted by "Hudson (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HBASE-5874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13288518#comment-13288518 ] 

Hudson commented on HBASE-5874:
-------------------------------

Integrated in HBase-0.92 #443 (See [https://builds.apache.org/job/HBase-0.92/443/])
    HBASE-5874 When 'fs.default.name' not configured, the hbck tool and Merge tool throws IllegalArgumentException (fulin wang) (Revision 1345905)

     Result = FAILURE
jmhsieh : 
Files : 
* /hbase/branches/0.92/CHANGES.txt
* /hbase/branches/0.92/src/main/java/org/apache/hadoop/hbase/util/HBaseFsck.java
* /hbase/branches/0.92/src/main/java/org/apache/hadoop/hbase/util/Merge.java

                
> When 'fs.default.name' not configured, the hbck tool and Merge tool throw IllegalArgumentException.
> ---------------------------------------------------------------------------------------------------
>
>                 Key: HBASE-5874
>                 URL: https://issues.apache.org/jira/browse/HBASE-5874
>             Project: HBase
>          Issue Type: Bug
>          Components: hbck
>    Affects Versions: 0.90.6
>            Reporter: fulin wang
>            Assignee: fulin wang
>             Fix For: 0.90.7, 0.96.0, 0.94.1, 0.92.3
>
>         Attachments: HBASE-5874-0.90-v2.patch, HBASE-5874-0.90.patch, HBASE-5874-trunk-v2.patch, HBASE-5874-trunk-v3.patch, HBASE-5874-trunk.patch
>
>
> The HBase do not configure the 'fs.default.name' attribute, the hbck tool and Merge tool throw IllegalArgumentException.
> the hbck tool and Merge tool, we should add 'fs.default.name' attriubte to the code.
> hbck exception:
> Exception in thread "main" java.lang.IllegalArgumentException: Wrong FS: hdfs://160.176.0.101:9000/hbase/.META./1028785192/.regioninfo, expected: file:///
> 	at org.apache.hadoop.fs.FileSystem.checkPath(FileSystem.java:412)
> 	at org.apache.hadoop.fs.RawLocalFileSystem.pathToFile(RawLocalFileSystem.java:59)
> 	at org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:382)
> 	at org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:285)
> 	at org.apache.hadoop.fs.ChecksumFileSystem$ChecksumFSInputChecker.<init>(ChecksumFileSystem.java:128)
> 	at org.apache.hadoop.fs.ChecksumFileSystem.open(ChecksumFileSystem.java:301)
> 	at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:489)
> 	at org.apache.hadoop.hbase.util.HBaseFsck.loadHdfsRegioninfo(HBaseFsck.java:565)
> 	at org.apache.hadoop.hbase.util.HBaseFsck.loadHdfsRegionInfos(HBaseFsck.java:596)
> 	at org.apache.hadoop.hbase.util.HBaseFsck.onlineConsistencyRepair(HBaseFsck.java:332)
> 	at org.apache.hadoop.hbase.util.HBaseFsck.onlineHbck(HBaseFsck.java:360)
> 	at org.apache.hadoop.hbase.util.HBaseFsck.main(HBaseFsck.java:2907)
>     
> Merge exception:  
> [2012-05-05 10:48:24,830] [ERROR] [main] [org.apache.hadoop.hbase.util.Merge 381] exiting due to error
> java.lang.IllegalArgumentException: Wrong FS: hdfs://160.176.0.101:9000/hbase/.META./1028785192/.regioninfo, expected: file:///
> 	at org.apache.hadoop.fs.FileSystem.checkPath(FileSystem.java:412)
> 	at org.apache.hadoop.fs.RawLocalFileSystem.pathToFile(RawLocalFileSystem.java:59)
> 	at org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:382)
> 	at org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:285)
> 	at org.apache.hadoop.fs.FileSystem.exists(FileSystem.java:823)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.checkRegioninfoOnFilesystem(HRegion.java:415)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.initialize(HRegion.java:340)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:2679)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:2665)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:2634)
> 	at org.apache.hadoop.hbase.util.MetaUtils.openMetaRegion(MetaUtils.java:276)
> 	at org.apache.hadoop.hbase.util.MetaUtils.scanMetaRegion(MetaUtils.java:261)
> 	at org.apache.hadoop.hbase.util.Merge.run(Merge.java:115)
> 	at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
> 	at org.apache.hadoop.hbase.util.Merge.main(Merge.java:379)

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HBASE-5874) When 'fs.default.name' not configured, the hbck tool and Merge tool throw IllegalArgumentException.

Posted by "Hudson (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HBASE-5874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13288488#comment-13288488 ] 

Hudson commented on HBASE-5874:
-------------------------------

Integrated in HBase-0.94 #244 (See [https://builds.apache.org/job/HBase-0.94/244/])
    HBASE-5874 When 'fs.default.name' not configured, the hbck tool and Merge tool throws IllegalArgumentException (fulin wang) (Revision 1345903)

     Result = SUCCESS
jmhsieh : 
Files : 
* /hbase/branches/0.94/src/main/java/org/apache/hadoop/hbase/util/HBaseFsck.java
* /hbase/branches/0.94/src/main/java/org/apache/hadoop/hbase/util/Merge.java

                
> When 'fs.default.name' not configured, the hbck tool and Merge tool throw IllegalArgumentException.
> ---------------------------------------------------------------------------------------------------
>
>                 Key: HBASE-5874
>                 URL: https://issues.apache.org/jira/browse/HBASE-5874
>             Project: HBase
>          Issue Type: Bug
>          Components: hbck
>    Affects Versions: 0.90.6
>            Reporter: fulin wang
>            Assignee: fulin wang
>             Fix For: 0.90.7, 0.96.0, 0.94.1, 0.92.3
>
>         Attachments: HBASE-5874-0.90-v2.patch, HBASE-5874-0.90.patch, HBASE-5874-trunk-v2.patch, HBASE-5874-trunk-v3.patch, HBASE-5874-trunk.patch
>
>
> The HBase do not configure the 'fs.default.name' attribute, the hbck tool and Merge tool throw IllegalArgumentException.
> the hbck tool and Merge tool, we should add 'fs.default.name' attriubte to the code.
> hbck exception:
> Exception in thread "main" java.lang.IllegalArgumentException: Wrong FS: hdfs://160.176.0.101:9000/hbase/.META./1028785192/.regioninfo, expected: file:///
> 	at org.apache.hadoop.fs.FileSystem.checkPath(FileSystem.java:412)
> 	at org.apache.hadoop.fs.RawLocalFileSystem.pathToFile(RawLocalFileSystem.java:59)
> 	at org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:382)
> 	at org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:285)
> 	at org.apache.hadoop.fs.ChecksumFileSystem$ChecksumFSInputChecker.<init>(ChecksumFileSystem.java:128)
> 	at org.apache.hadoop.fs.ChecksumFileSystem.open(ChecksumFileSystem.java:301)
> 	at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:489)
> 	at org.apache.hadoop.hbase.util.HBaseFsck.loadHdfsRegioninfo(HBaseFsck.java:565)
> 	at org.apache.hadoop.hbase.util.HBaseFsck.loadHdfsRegionInfos(HBaseFsck.java:596)
> 	at org.apache.hadoop.hbase.util.HBaseFsck.onlineConsistencyRepair(HBaseFsck.java:332)
> 	at org.apache.hadoop.hbase.util.HBaseFsck.onlineHbck(HBaseFsck.java:360)
> 	at org.apache.hadoop.hbase.util.HBaseFsck.main(HBaseFsck.java:2907)
>     
> Merge exception:  
> [2012-05-05 10:48:24,830] [ERROR] [main] [org.apache.hadoop.hbase.util.Merge 381] exiting due to error
> java.lang.IllegalArgumentException: Wrong FS: hdfs://160.176.0.101:9000/hbase/.META./1028785192/.regioninfo, expected: file:///
> 	at org.apache.hadoop.fs.FileSystem.checkPath(FileSystem.java:412)
> 	at org.apache.hadoop.fs.RawLocalFileSystem.pathToFile(RawLocalFileSystem.java:59)
> 	at org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:382)
> 	at org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:285)
> 	at org.apache.hadoop.fs.FileSystem.exists(FileSystem.java:823)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.checkRegioninfoOnFilesystem(HRegion.java:415)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.initialize(HRegion.java:340)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:2679)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:2665)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:2634)
> 	at org.apache.hadoop.hbase.util.MetaUtils.openMetaRegion(MetaUtils.java:276)
> 	at org.apache.hadoop.hbase.util.MetaUtils.scanMetaRegion(MetaUtils.java:261)
> 	at org.apache.hadoop.hbase.util.Merge.run(Merge.java:115)
> 	at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
> 	at org.apache.hadoop.hbase.util.Merge.main(Merge.java:379)

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HBASE-5874) The HBase do not configure the 'fs.default.name' attribute, the hbck tool and Merge tool throw IllegalArgumentException.

Posted by "Jieshan Bean (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HBASE-5874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13264882#comment-13264882 ] 

Jieshan Bean commented on HBASE-5874:
-------------------------------------

+1 on this patch.
I think the patches for other branches are also needed.
                
> The HBase do not configure the 'fs.default.name' attribute, the hbck tool and Merge tool throw IllegalArgumentException.
> ------------------------------------------------------------------------------------------------------------------------
>
>                 Key: HBASE-5874
>                 URL: https://issues.apache.org/jira/browse/HBASE-5874
>             Project: HBase
>          Issue Type: Bug
>          Components: hbck
>    Affects Versions: 0.90.6
>            Reporter: fulin wang
>            Assignee: fulin wang
>         Attachments: HBASE-5874-0.90.patch, HBASE-5874-trunk.patch
>
>
> The HBase do not configure the 'fs.default.name' attribute, the hbck tool and Merge tool throw IllegalArgumentException.
> the hbck tool and Merge tool, we should add 'fs.default.name' attriubte to the code.
> hbck exception:
> Exception in thread "main" java.lang.IllegalArgumentException: Wrong FS: hdfs://160.176.0.101:9000/hbase/.META./1028785192/.regioninfo, expected: file:///
> 	at org.apache.hadoop.fs.FileSystem.checkPath(FileSystem.java:412)
> 	at org.apache.hadoop.fs.RawLocalFileSystem.pathToFile(RawLocalFileSystem.java:59)
> 	at org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:382)
> 	at org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:285)
> 	at org.apache.hadoop.fs.ChecksumFileSystem$ChecksumFSInputChecker.<init>(ChecksumFileSystem.java:128)
> 	at org.apache.hadoop.fs.ChecksumFileSystem.open(ChecksumFileSystem.java:301)
> 	at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:489)
> 	at org.apache.hadoop.hbase.util.HBaseFsck.loadHdfsRegioninfo(HBaseFsck.java:565)
> 	at org.apache.hadoop.hbase.util.HBaseFsck.loadHdfsRegionInfos(HBaseFsck.java:596)
> 	at org.apache.hadoop.hbase.util.HBaseFsck.onlineConsistencyRepair(HBaseFsck.java:332)
> 	at org.apache.hadoop.hbase.util.HBaseFsck.onlineHbck(HBaseFsck.java:360)
> 	at org.apache.hadoop.hbase.util.HBaseFsck.main(HBaseFsck.java:2907)
>     
> Merge exception:  
> [2012-05-05 10:48:24,830] [ERROR] [main] [org.apache.hadoop.hbase.util.Merge 381] exiting due to error
> java.lang.IllegalArgumentException: Wrong FS: hdfs://160.176.0.101:9000/hbase/.META./1028785192/.regioninfo, expected: file:///
> 	at org.apache.hadoop.fs.FileSystem.checkPath(FileSystem.java:412)
> 	at org.apache.hadoop.fs.RawLocalFileSystem.pathToFile(RawLocalFileSystem.java:59)
> 	at org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:382)
> 	at org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:285)
> 	at org.apache.hadoop.fs.FileSystem.exists(FileSystem.java:823)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.checkRegioninfoOnFilesystem(HRegion.java:415)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.initialize(HRegion.java:340)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:2679)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:2665)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:2634)
> 	at org.apache.hadoop.hbase.util.MetaUtils.openMetaRegion(MetaUtils.java:276)
> 	at org.apache.hadoop.hbase.util.MetaUtils.scanMetaRegion(MetaUtils.java:261)
> 	at org.apache.hadoop.hbase.util.Merge.run(Merge.java:115)
> 	at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
> 	at org.apache.hadoop.hbase.util.Merge.main(Merge.java:379)

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (HBASE-5874) The HBase do not configure the 'fs.default.name' attribute, the hbck tool and Merge tool throw IllegalArgumentException.

Posted by "fulin wang (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HBASE-5874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

fulin wang updated HBASE-5874:
------------------------------

    Attachment: HBASE-5874-trunk-v3.patch

Thank Jonathan Hsieh review.
By your suggest, I make a patch, Please review.
If you think the patch has problem, Please modify, Thanks.
                
> The HBase do not configure the 'fs.default.name' attribute, the hbck tool and Merge tool throw IllegalArgumentException.
> ------------------------------------------------------------------------------------------------------------------------
>
>                 Key: HBASE-5874
>                 URL: https://issues.apache.org/jira/browse/HBASE-5874
>             Project: HBase
>          Issue Type: Bug
>          Components: hbck
>    Affects Versions: 0.90.6
>            Reporter: fulin wang
>            Assignee: fulin wang
>         Attachments: HBASE-5874-0.90-v2.patch, HBASE-5874-0.90.patch, HBASE-5874-trunk-v2.patch, HBASE-5874-trunk-v3.patch, HBASE-5874-trunk.patch
>
>
> The HBase do not configure the 'fs.default.name' attribute, the hbck tool and Merge tool throw IllegalArgumentException.
> the hbck tool and Merge tool, we should add 'fs.default.name' attriubte to the code.
> hbck exception:
> Exception in thread "main" java.lang.IllegalArgumentException: Wrong FS: hdfs://160.176.0.101:9000/hbase/.META./1028785192/.regioninfo, expected: file:///
> 	at org.apache.hadoop.fs.FileSystem.checkPath(FileSystem.java:412)
> 	at org.apache.hadoop.fs.RawLocalFileSystem.pathToFile(RawLocalFileSystem.java:59)
> 	at org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:382)
> 	at org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:285)
> 	at org.apache.hadoop.fs.ChecksumFileSystem$ChecksumFSInputChecker.<init>(ChecksumFileSystem.java:128)
> 	at org.apache.hadoop.fs.ChecksumFileSystem.open(ChecksumFileSystem.java:301)
> 	at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:489)
> 	at org.apache.hadoop.hbase.util.HBaseFsck.loadHdfsRegioninfo(HBaseFsck.java:565)
> 	at org.apache.hadoop.hbase.util.HBaseFsck.loadHdfsRegionInfos(HBaseFsck.java:596)
> 	at org.apache.hadoop.hbase.util.HBaseFsck.onlineConsistencyRepair(HBaseFsck.java:332)
> 	at org.apache.hadoop.hbase.util.HBaseFsck.onlineHbck(HBaseFsck.java:360)
> 	at org.apache.hadoop.hbase.util.HBaseFsck.main(HBaseFsck.java:2907)
>     
> Merge exception:  
> [2012-05-05 10:48:24,830] [ERROR] [main] [org.apache.hadoop.hbase.util.Merge 381] exiting due to error
> java.lang.IllegalArgumentException: Wrong FS: hdfs://160.176.0.101:9000/hbase/.META./1028785192/.regioninfo, expected: file:///
> 	at org.apache.hadoop.fs.FileSystem.checkPath(FileSystem.java:412)
> 	at org.apache.hadoop.fs.RawLocalFileSystem.pathToFile(RawLocalFileSystem.java:59)
> 	at org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:382)
> 	at org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:285)
> 	at org.apache.hadoop.fs.FileSystem.exists(FileSystem.java:823)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.checkRegioninfoOnFilesystem(HRegion.java:415)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.initialize(HRegion.java:340)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:2679)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:2665)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:2634)
> 	at org.apache.hadoop.hbase.util.MetaUtils.openMetaRegion(MetaUtils.java:276)
> 	at org.apache.hadoop.hbase.util.MetaUtils.scanMetaRegion(MetaUtils.java:261)
> 	at org.apache.hadoop.hbase.util.Merge.run(Merge.java:115)
> 	at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
> 	at org.apache.hadoop.hbase.util.Merge.main(Merge.java:379)

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (HBASE-5874) The HBase do not configure the 'fs.default.name' attribute, the hbck tool and Merge tool throw IllegalArgumentException.

Posted by "fulin wang (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HBASE-5874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

fulin wang updated HBASE-5874:
------------------------------

    Attachment:     (was: HBASE-5874-0.90.patch)
    
> The HBase do not configure the 'fs.default.name' attribute, the hbck tool and Merge tool throw IllegalArgumentException.
> ------------------------------------------------------------------------------------------------------------------------
>
>                 Key: HBASE-5874
>                 URL: https://issues.apache.org/jira/browse/HBASE-5874
>             Project: HBase
>          Issue Type: Bug
>          Components: hbck
>    Affects Versions: 0.90.6
>            Reporter: fulin wang
>         Attachments: HBASE-5874-0.90.patch
>
>
> The HBase do not configure the 'fs.default.name' attribute, the hbck tool and Merge tool throw IllegalArgumentException.
> the hbck tool and Merge tool, we should add 'fs.default.name' attriubte to the code.
> hbck exception:
> Exception in thread "main" java.lang.IllegalArgumentException: Wrong FS: hdfs://160.176.0.101:9000/hbase/.META./1028785192/.regioninfo, expected: file:///
> 	at org.apache.hadoop.fs.FileSystem.checkPath(FileSystem.java:412)
> 	at org.apache.hadoop.fs.RawLocalFileSystem.pathToFile(RawLocalFileSystem.java:59)
> 	at org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:382)
> 	at org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:285)
> 	at org.apache.hadoop.fs.ChecksumFileSystem$ChecksumFSInputChecker.<init>(ChecksumFileSystem.java:128)
> 	at org.apache.hadoop.fs.ChecksumFileSystem.open(ChecksumFileSystem.java:301)
> 	at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:489)
> 	at org.apache.hadoop.hbase.util.HBaseFsck.loadHdfsRegioninfo(HBaseFsck.java:565)
> 	at org.apache.hadoop.hbase.util.HBaseFsck.loadHdfsRegionInfos(HBaseFsck.java:596)
> 	at org.apache.hadoop.hbase.util.HBaseFsck.onlineConsistencyRepair(HBaseFsck.java:332)
> 	at org.apache.hadoop.hbase.util.HBaseFsck.onlineHbck(HBaseFsck.java:360)
> 	at org.apache.hadoop.hbase.util.HBaseFsck.main(HBaseFsck.java:2907)
>     
> Merge exception:  
> [2012-05-05 10:48:24,830] [ERROR] [main] [org.apache.hadoop.hbase.util.Merge 381] exiting due to error
> java.lang.IllegalArgumentException: Wrong FS: hdfs://160.176.0.101:9000/hbase/.META./1028785192/.regioninfo, expected: file:///
> 	at org.apache.hadoop.fs.FileSystem.checkPath(FileSystem.java:412)
> 	at org.apache.hadoop.fs.RawLocalFileSystem.pathToFile(RawLocalFileSystem.java:59)
> 	at org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:382)
> 	at org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:285)
> 	at org.apache.hadoop.fs.FileSystem.exists(FileSystem.java:823)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.checkRegioninfoOnFilesystem(HRegion.java:415)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.initialize(HRegion.java:340)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:2679)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:2665)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:2634)
> 	at org.apache.hadoop.hbase.util.MetaUtils.openMetaRegion(MetaUtils.java:276)
> 	at org.apache.hadoop.hbase.util.MetaUtils.scanMetaRegion(MetaUtils.java:261)
> 	at org.apache.hadoop.hbase.util.Merge.run(Merge.java:115)
> 	at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
> 	at org.apache.hadoop.hbase.util.Merge.main(Merge.java:379)

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (HBASE-5874) The HBase do not configure the 'fs.default.name' attribute, the hbck tool and Merge tool throw IllegalArgumentException.

Posted by "fulin wang (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HBASE-5874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

fulin wang updated HBASE-5874:
------------------------------

    Attachment: HBASE-5874-0.90.patch
    
> The HBase do not configure the 'fs.default.name' attribute, the hbck tool and Merge tool throw IllegalArgumentException.
> ------------------------------------------------------------------------------------------------------------------------
>
>                 Key: HBASE-5874
>                 URL: https://issues.apache.org/jira/browse/HBASE-5874
>             Project: HBase
>          Issue Type: Bug
>          Components: hbck
>    Affects Versions: 0.90.6
>            Reporter: fulin wang
>         Attachments: HBASE-5874-0.90.patch
>
>
> The HBase do not configure the 'fs.default.name' attribute, the hbck tool and Merge tool throw IllegalArgumentException.
> the hbck tool and Merge tool, we should add 'fs.default.name' attriubte to the code.
> hbck exception:
> Exception in thread "main" java.lang.IllegalArgumentException: Wrong FS: hdfs://160.176.0.101:9000/hbase/.META./1028785192/.regioninfo, expected: file:///
> 	at org.apache.hadoop.fs.FileSystem.checkPath(FileSystem.java:412)
> 	at org.apache.hadoop.fs.RawLocalFileSystem.pathToFile(RawLocalFileSystem.java:59)
> 	at org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:382)
> 	at org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:285)
> 	at org.apache.hadoop.fs.ChecksumFileSystem$ChecksumFSInputChecker.<init>(ChecksumFileSystem.java:128)
> 	at org.apache.hadoop.fs.ChecksumFileSystem.open(ChecksumFileSystem.java:301)
> 	at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:489)
> 	at org.apache.hadoop.hbase.util.HBaseFsck.loadHdfsRegioninfo(HBaseFsck.java:565)
> 	at org.apache.hadoop.hbase.util.HBaseFsck.loadHdfsRegionInfos(HBaseFsck.java:596)
> 	at org.apache.hadoop.hbase.util.HBaseFsck.onlineConsistencyRepair(HBaseFsck.java:332)
> 	at org.apache.hadoop.hbase.util.HBaseFsck.onlineHbck(HBaseFsck.java:360)
> 	at org.apache.hadoop.hbase.util.HBaseFsck.main(HBaseFsck.java:2907)
>     
> Merge exception:  
> [2012-05-05 10:48:24,830] [ERROR] [main] [org.apache.hadoop.hbase.util.Merge 381] exiting due to error
> java.lang.IllegalArgumentException: Wrong FS: hdfs://160.176.0.101:9000/hbase/.META./1028785192/.regioninfo, expected: file:///
> 	at org.apache.hadoop.fs.FileSystem.checkPath(FileSystem.java:412)
> 	at org.apache.hadoop.fs.RawLocalFileSystem.pathToFile(RawLocalFileSystem.java:59)
> 	at org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:382)
> 	at org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:285)
> 	at org.apache.hadoop.fs.FileSystem.exists(FileSystem.java:823)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.checkRegioninfoOnFilesystem(HRegion.java:415)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.initialize(HRegion.java:340)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:2679)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:2665)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:2634)
> 	at org.apache.hadoop.hbase.util.MetaUtils.openMetaRegion(MetaUtils.java:276)
> 	at org.apache.hadoop.hbase.util.MetaUtils.scanMetaRegion(MetaUtils.java:261)
> 	at org.apache.hadoop.hbase.util.Merge.run(Merge.java:115)
> 	at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
> 	at org.apache.hadoop.hbase.util.Merge.main(Merge.java:379)

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HBASE-5874) The HBase do not configure the 'fs.default.name' attribute, the hbck tool and Merge tool throw IllegalArgumentException.

Posted by "Jonathan Hsieh (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HBASE-5874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13263681#comment-13263681 ] 

Jonathan Hsieh commented on HBASE-5874:
---------------------------------------

Fulin:

Have you tried using the tool after the patch?  

Do you have a dir with hdfs-site.xml in it in your 'hbase classpath'?

Actually looking at it, I don't think the original hbck line that potentially sets fs.defaultFS to the HBASE root dir makes sense at all.  Setting the fs.default.name also seems incorrect.  I'm actually more inclined to just remove the line.  Maybe it would be better to allow the user to override the value by converting hbck  into subclass of Tool?

In the case of Merge, it is a Tool already so if you don't have your hdfs-site.xml files in the hbase classpath you could run it with an extra flag to override particular properties such as fs.default.name.

{code}
hbase org.apache.hadoop.hbase.util.Merge -Dfs.default.name=hdfs://nn:port <normal args>
{code}

                
> The HBase do not configure the 'fs.default.name' attribute, the hbck tool and Merge tool throw IllegalArgumentException.
> ------------------------------------------------------------------------------------------------------------------------
>
>                 Key: HBASE-5874
>                 URL: https://issues.apache.org/jira/browse/HBASE-5874
>             Project: HBase
>          Issue Type: Bug
>          Components: hbck
>    Affects Versions: 0.90.6
>            Reporter: fulin wang
>         Attachments: HBASE-5874-0.90.patch, HBASE-5874-trunk.patch
>
>
> The HBase do not configure the 'fs.default.name' attribute, the hbck tool and Merge tool throw IllegalArgumentException.
> the hbck tool and Merge tool, we should add 'fs.default.name' attriubte to the code.
> hbck exception:
> Exception in thread "main" java.lang.IllegalArgumentException: Wrong FS: hdfs://160.176.0.101:9000/hbase/.META./1028785192/.regioninfo, expected: file:///
> 	at org.apache.hadoop.fs.FileSystem.checkPath(FileSystem.java:412)
> 	at org.apache.hadoop.fs.RawLocalFileSystem.pathToFile(RawLocalFileSystem.java:59)
> 	at org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:382)
> 	at org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:285)
> 	at org.apache.hadoop.fs.ChecksumFileSystem$ChecksumFSInputChecker.<init>(ChecksumFileSystem.java:128)
> 	at org.apache.hadoop.fs.ChecksumFileSystem.open(ChecksumFileSystem.java:301)
> 	at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:489)
> 	at org.apache.hadoop.hbase.util.HBaseFsck.loadHdfsRegioninfo(HBaseFsck.java:565)
> 	at org.apache.hadoop.hbase.util.HBaseFsck.loadHdfsRegionInfos(HBaseFsck.java:596)
> 	at org.apache.hadoop.hbase.util.HBaseFsck.onlineConsistencyRepair(HBaseFsck.java:332)
> 	at org.apache.hadoop.hbase.util.HBaseFsck.onlineHbck(HBaseFsck.java:360)
> 	at org.apache.hadoop.hbase.util.HBaseFsck.main(HBaseFsck.java:2907)
>     
> Merge exception:  
> [2012-05-05 10:48:24,830] [ERROR] [main] [org.apache.hadoop.hbase.util.Merge 381] exiting due to error
> java.lang.IllegalArgumentException: Wrong FS: hdfs://160.176.0.101:9000/hbase/.META./1028785192/.regioninfo, expected: file:///
> 	at org.apache.hadoop.fs.FileSystem.checkPath(FileSystem.java:412)
> 	at org.apache.hadoop.fs.RawLocalFileSystem.pathToFile(RawLocalFileSystem.java:59)
> 	at org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:382)
> 	at org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:285)
> 	at org.apache.hadoop.fs.FileSystem.exists(FileSystem.java:823)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.checkRegioninfoOnFilesystem(HRegion.java:415)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.initialize(HRegion.java:340)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:2679)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:2665)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:2634)
> 	at org.apache.hadoop.hbase.util.MetaUtils.openMetaRegion(MetaUtils.java:276)
> 	at org.apache.hadoop.hbase.util.MetaUtils.scanMetaRegion(MetaUtils.java:261)
> 	at org.apache.hadoop.hbase.util.Merge.run(Merge.java:115)
> 	at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
> 	at org.apache.hadoop.hbase.util.Merge.main(Merge.java:379)

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HBASE-5874) The HBase do not configure the 'fs.default.name' attribute, the hbck tool and Merge tool throw IllegalArgumentException.

Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HBASE-5874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13271346#comment-13271346 ] 

Hadoop QA commented on HBASE-5874:
----------------------------------

-1 overall.  Here are the results of testing the latest attachment 
  http://issues.apache.org/jira/secure/attachment/12526143/HBASE-5874-trunk-v2.patch
  against trunk revision .

    +1 @author.  The patch does not contain any @author tags.

    -1 tests included.  The patch doesn't appear to include any new or modified tests.
                        Please justify why no new tests are needed for this patch.
                        Also please list what manual steps were performed to verify this patch.

    +1 hadoop23.  The patch compiles against the hadoop 0.23.x profile.

    +1 javadoc.  The javadoc tool did not generate any warning messages.

    +1 javac.  The applied patch does not increase the total number of javac compiler warnings.

    +1 findbugs.  The patch does not introduce any new Findbugs (version 1.3.9) warnings.

    +1 release audit.  The applied patch does not increase the total number of release audit warnings.

     -1 core tests.  The patch failed these unit tests:
                       org.apache.hadoop.hbase.master.TestAssignmentManager

Test results: https://builds.apache.org/job/PreCommit-HBASE-Build/1815//testReport/
Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/1815//artifact/trunk/patchprocess/newPatchFindbugsWarnings.html
Console output: https://builds.apache.org/job/PreCommit-HBASE-Build/1815//console

This message is automatically generated.
                
> The HBase do not configure the 'fs.default.name' attribute, the hbck tool and Merge tool throw IllegalArgumentException.
> ------------------------------------------------------------------------------------------------------------------------
>
>                 Key: HBASE-5874
>                 URL: https://issues.apache.org/jira/browse/HBASE-5874
>             Project: HBase
>          Issue Type: Bug
>          Components: hbck
>    Affects Versions: 0.90.6
>            Reporter: fulin wang
>            Assignee: fulin wang
>         Attachments: HBASE-5874-0.90-v2.patch, HBASE-5874-0.90.patch, HBASE-5874-trunk-v2.patch, HBASE-5874-trunk.patch
>
>
> The HBase do not configure the 'fs.default.name' attribute, the hbck tool and Merge tool throw IllegalArgumentException.
> the hbck tool and Merge tool, we should add 'fs.default.name' attriubte to the code.
> hbck exception:
> Exception in thread "main" java.lang.IllegalArgumentException: Wrong FS: hdfs://160.176.0.101:9000/hbase/.META./1028785192/.regioninfo, expected: file:///
> 	at org.apache.hadoop.fs.FileSystem.checkPath(FileSystem.java:412)
> 	at org.apache.hadoop.fs.RawLocalFileSystem.pathToFile(RawLocalFileSystem.java:59)
> 	at org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:382)
> 	at org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:285)
> 	at org.apache.hadoop.fs.ChecksumFileSystem$ChecksumFSInputChecker.<init>(ChecksumFileSystem.java:128)
> 	at org.apache.hadoop.fs.ChecksumFileSystem.open(ChecksumFileSystem.java:301)
> 	at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:489)
> 	at org.apache.hadoop.hbase.util.HBaseFsck.loadHdfsRegioninfo(HBaseFsck.java:565)
> 	at org.apache.hadoop.hbase.util.HBaseFsck.loadHdfsRegionInfos(HBaseFsck.java:596)
> 	at org.apache.hadoop.hbase.util.HBaseFsck.onlineConsistencyRepair(HBaseFsck.java:332)
> 	at org.apache.hadoop.hbase.util.HBaseFsck.onlineHbck(HBaseFsck.java:360)
> 	at org.apache.hadoop.hbase.util.HBaseFsck.main(HBaseFsck.java:2907)
>     
> Merge exception:  
> [2012-05-05 10:48:24,830] [ERROR] [main] [org.apache.hadoop.hbase.util.Merge 381] exiting due to error
> java.lang.IllegalArgumentException: Wrong FS: hdfs://160.176.0.101:9000/hbase/.META./1028785192/.regioninfo, expected: file:///
> 	at org.apache.hadoop.fs.FileSystem.checkPath(FileSystem.java:412)
> 	at org.apache.hadoop.fs.RawLocalFileSystem.pathToFile(RawLocalFileSystem.java:59)
> 	at org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:382)
> 	at org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:285)
> 	at org.apache.hadoop.fs.FileSystem.exists(FileSystem.java:823)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.checkRegioninfoOnFilesystem(HRegion.java:415)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.initialize(HRegion.java:340)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:2679)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:2665)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:2634)
> 	at org.apache.hadoop.hbase.util.MetaUtils.openMetaRegion(MetaUtils.java:276)
> 	at org.apache.hadoop.hbase.util.MetaUtils.scanMetaRegion(MetaUtils.java:261)
> 	at org.apache.hadoop.hbase.util.Merge.run(Merge.java:115)
> 	at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
> 	at org.apache.hadoop.hbase.util.Merge.main(Merge.java:379)

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Issue Comment Edited] (HBASE-5874) The HBase do not configure the 'fs.default.name' attribute, the hbck tool and Merge tool throw IllegalArgumentException.

Posted by "Jonathan Hsieh (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HBASE-5874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13270540#comment-13270540 ] 

Jonathan Hsieh edited comment on HBASE-5874 at 5/8/12 3:31 PM:
---------------------------------------------------------------

Hey fulin,  Sorry for the delay -- let me clarify:

The patch (and the old version) would set the fs.default.name and fs.defaultFS to something like hdfs://nn:port/hbase while it should only set it to hdfs://nn:port (notice no path).  

I'm not convinced that merge the code is needed -- instead maybe you could change the help message to demonstrate the -Dfs.default.name syntax to pick arbitrary files/filesystems instead? 
                
      was (Author: jmhsieh):
    Hey fulin,  Sorry for the delay -- let me clarify:

The patch (and the old version) would set the fs.default.name and fs.defaultFS to something like hdfs://nn:port/hbase while it should only set it to hdfs://nn:port (notice no path).  

I'm not convinced that merge the code is needed -- instead many you could change the help message to demonstrate the -Dfs.default.name syntax to pick arbitrary files/filesystems instead? 
                  
> The HBase do not configure the 'fs.default.name' attribute, the hbck tool and Merge tool throw IllegalArgumentException.
> ------------------------------------------------------------------------------------------------------------------------
>
>                 Key: HBASE-5874
>                 URL: https://issues.apache.org/jira/browse/HBASE-5874
>             Project: HBase
>          Issue Type: Bug
>          Components: hbck
>    Affects Versions: 0.90.6
>            Reporter: fulin wang
>            Assignee: fulin wang
>         Attachments: HBASE-5874-0.90.patch, HBASE-5874-trunk.patch
>
>
> The HBase do not configure the 'fs.default.name' attribute, the hbck tool and Merge tool throw IllegalArgumentException.
> the hbck tool and Merge tool, we should add 'fs.default.name' attriubte to the code.
> hbck exception:
> Exception in thread "main" java.lang.IllegalArgumentException: Wrong FS: hdfs://160.176.0.101:9000/hbase/.META./1028785192/.regioninfo, expected: file:///
> 	at org.apache.hadoop.fs.FileSystem.checkPath(FileSystem.java:412)
> 	at org.apache.hadoop.fs.RawLocalFileSystem.pathToFile(RawLocalFileSystem.java:59)
> 	at org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:382)
> 	at org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:285)
> 	at org.apache.hadoop.fs.ChecksumFileSystem$ChecksumFSInputChecker.<init>(ChecksumFileSystem.java:128)
> 	at org.apache.hadoop.fs.ChecksumFileSystem.open(ChecksumFileSystem.java:301)
> 	at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:489)
> 	at org.apache.hadoop.hbase.util.HBaseFsck.loadHdfsRegioninfo(HBaseFsck.java:565)
> 	at org.apache.hadoop.hbase.util.HBaseFsck.loadHdfsRegionInfos(HBaseFsck.java:596)
> 	at org.apache.hadoop.hbase.util.HBaseFsck.onlineConsistencyRepair(HBaseFsck.java:332)
> 	at org.apache.hadoop.hbase.util.HBaseFsck.onlineHbck(HBaseFsck.java:360)
> 	at org.apache.hadoop.hbase.util.HBaseFsck.main(HBaseFsck.java:2907)
>     
> Merge exception:  
> [2012-05-05 10:48:24,830] [ERROR] [main] [org.apache.hadoop.hbase.util.Merge 381] exiting due to error
> java.lang.IllegalArgumentException: Wrong FS: hdfs://160.176.0.101:9000/hbase/.META./1028785192/.regioninfo, expected: file:///
> 	at org.apache.hadoop.fs.FileSystem.checkPath(FileSystem.java:412)
> 	at org.apache.hadoop.fs.RawLocalFileSystem.pathToFile(RawLocalFileSystem.java:59)
> 	at org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:382)
> 	at org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:285)
> 	at org.apache.hadoop.fs.FileSystem.exists(FileSystem.java:823)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.checkRegioninfoOnFilesystem(HRegion.java:415)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.initialize(HRegion.java:340)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:2679)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:2665)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:2634)
> 	at org.apache.hadoop.hbase.util.MetaUtils.openMetaRegion(MetaUtils.java:276)
> 	at org.apache.hadoop.hbase.util.MetaUtils.scanMetaRegion(MetaUtils.java:261)
> 	at org.apache.hadoop.hbase.util.Merge.run(Merge.java:115)
> 	at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
> 	at org.apache.hadoop.hbase.util.Merge.main(Merge.java:379)

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HBASE-5874) The HBase do not configure the 'fs.default.name' attribute, the hbck tool and Merge tool throw IllegalArgumentException.

Posted by "Jonathan Hsieh (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HBASE-5874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13270540#comment-13270540 ] 

Jonathan Hsieh commented on HBASE-5874:
---------------------------------------

Hey fulin,  Sorry for the delay -- let me clarify:

The patch (and the old version) would set the fs.default.name and fs.defaultFS to something like hdfs://nn:port/hbase while it should only set it to hdfs://nn:port (notice no path).  

I'm not convinced that merge the code is needed -- instead many you could change the help message to demonstrate the -Dfs.default.name syntax to pick arbitrary files/filesystems instead? 
                
> The HBase do not configure the 'fs.default.name' attribute, the hbck tool and Merge tool throw IllegalArgumentException.
> ------------------------------------------------------------------------------------------------------------------------
>
>                 Key: HBASE-5874
>                 URL: https://issues.apache.org/jira/browse/HBASE-5874
>             Project: HBase
>          Issue Type: Bug
>          Components: hbck
>    Affects Versions: 0.90.6
>            Reporter: fulin wang
>            Assignee: fulin wang
>         Attachments: HBASE-5874-0.90.patch, HBASE-5874-trunk.patch
>
>
> The HBase do not configure the 'fs.default.name' attribute, the hbck tool and Merge tool throw IllegalArgumentException.
> the hbck tool and Merge tool, we should add 'fs.default.name' attriubte to the code.
> hbck exception:
> Exception in thread "main" java.lang.IllegalArgumentException: Wrong FS: hdfs://160.176.0.101:9000/hbase/.META./1028785192/.regioninfo, expected: file:///
> 	at org.apache.hadoop.fs.FileSystem.checkPath(FileSystem.java:412)
> 	at org.apache.hadoop.fs.RawLocalFileSystem.pathToFile(RawLocalFileSystem.java:59)
> 	at org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:382)
> 	at org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:285)
> 	at org.apache.hadoop.fs.ChecksumFileSystem$ChecksumFSInputChecker.<init>(ChecksumFileSystem.java:128)
> 	at org.apache.hadoop.fs.ChecksumFileSystem.open(ChecksumFileSystem.java:301)
> 	at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:489)
> 	at org.apache.hadoop.hbase.util.HBaseFsck.loadHdfsRegioninfo(HBaseFsck.java:565)
> 	at org.apache.hadoop.hbase.util.HBaseFsck.loadHdfsRegionInfos(HBaseFsck.java:596)
> 	at org.apache.hadoop.hbase.util.HBaseFsck.onlineConsistencyRepair(HBaseFsck.java:332)
> 	at org.apache.hadoop.hbase.util.HBaseFsck.onlineHbck(HBaseFsck.java:360)
> 	at org.apache.hadoop.hbase.util.HBaseFsck.main(HBaseFsck.java:2907)
>     
> Merge exception:  
> [2012-05-05 10:48:24,830] [ERROR] [main] [org.apache.hadoop.hbase.util.Merge 381] exiting due to error
> java.lang.IllegalArgumentException: Wrong FS: hdfs://160.176.0.101:9000/hbase/.META./1028785192/.regioninfo, expected: file:///
> 	at org.apache.hadoop.fs.FileSystem.checkPath(FileSystem.java:412)
> 	at org.apache.hadoop.fs.RawLocalFileSystem.pathToFile(RawLocalFileSystem.java:59)
> 	at org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:382)
> 	at org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:285)
> 	at org.apache.hadoop.fs.FileSystem.exists(FileSystem.java:823)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.checkRegioninfoOnFilesystem(HRegion.java:415)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.initialize(HRegion.java:340)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:2679)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:2665)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:2634)
> 	at org.apache.hadoop.hbase.util.MetaUtils.openMetaRegion(MetaUtils.java:276)
> 	at org.apache.hadoop.hbase.util.MetaUtils.scanMetaRegion(MetaUtils.java:261)
> 	at org.apache.hadoop.hbase.util.Merge.run(Merge.java:115)
> 	at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
> 	at org.apache.hadoop.hbase.util.Merge.main(Merge.java:379)

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HBASE-5874) When 'fs.default.name' not configured, the hbck tool and Merge tool throw IllegalArgumentException.

Posted by "fulin wang (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HBASE-5874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13293235#comment-13293235 ] 

fulin wang commented on HBASE-5874:
-----------------------------------

Thanks Hudson for your attention.
                
> When 'fs.default.name' not configured, the hbck tool and Merge tool throw IllegalArgumentException.
> ---------------------------------------------------------------------------------------------------
>
>                 Key: HBASE-5874
>                 URL: https://issues.apache.org/jira/browse/HBASE-5874
>             Project: HBase
>          Issue Type: Bug
>          Components: hbck
>    Affects Versions: 0.90.6
>            Reporter: fulin wang
>            Assignee: fulin wang
>             Fix For: 0.90.7, 0.96.0, 0.94.1, 0.92.3
>
>         Attachments: HBASE-5874-0.90-v2.patch, HBASE-5874-0.90.patch, HBASE-5874-trunk-v2.patch, HBASE-5874-trunk-v3.patch, HBASE-5874-trunk.patch
>
>
> The HBase do not configure the 'fs.default.name' attribute, the hbck tool and Merge tool throw IllegalArgumentException.
> the hbck tool and Merge tool, we should add 'fs.default.name' attriubte to the code.
> hbck exception:
> Exception in thread "main" java.lang.IllegalArgumentException: Wrong FS: hdfs://160.176.0.101:9000/hbase/.META./1028785192/.regioninfo, expected: file:///
> 	at org.apache.hadoop.fs.FileSystem.checkPath(FileSystem.java:412)
> 	at org.apache.hadoop.fs.RawLocalFileSystem.pathToFile(RawLocalFileSystem.java:59)
> 	at org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:382)
> 	at org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:285)
> 	at org.apache.hadoop.fs.ChecksumFileSystem$ChecksumFSInputChecker.<init>(ChecksumFileSystem.java:128)
> 	at org.apache.hadoop.fs.ChecksumFileSystem.open(ChecksumFileSystem.java:301)
> 	at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:489)
> 	at org.apache.hadoop.hbase.util.HBaseFsck.loadHdfsRegioninfo(HBaseFsck.java:565)
> 	at org.apache.hadoop.hbase.util.HBaseFsck.loadHdfsRegionInfos(HBaseFsck.java:596)
> 	at org.apache.hadoop.hbase.util.HBaseFsck.onlineConsistencyRepair(HBaseFsck.java:332)
> 	at org.apache.hadoop.hbase.util.HBaseFsck.onlineHbck(HBaseFsck.java:360)
> 	at org.apache.hadoop.hbase.util.HBaseFsck.main(HBaseFsck.java:2907)
>     
> Merge exception:  
> [2012-05-05 10:48:24,830] [ERROR] [main] [org.apache.hadoop.hbase.util.Merge 381] exiting due to error
> java.lang.IllegalArgumentException: Wrong FS: hdfs://160.176.0.101:9000/hbase/.META./1028785192/.regioninfo, expected: file:///
> 	at org.apache.hadoop.fs.FileSystem.checkPath(FileSystem.java:412)
> 	at org.apache.hadoop.fs.RawLocalFileSystem.pathToFile(RawLocalFileSystem.java:59)
> 	at org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:382)
> 	at org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:285)
> 	at org.apache.hadoop.fs.FileSystem.exists(FileSystem.java:823)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.checkRegioninfoOnFilesystem(HRegion.java:415)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.initialize(HRegion.java:340)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:2679)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:2665)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:2634)
> 	at org.apache.hadoop.hbase.util.MetaUtils.openMetaRegion(MetaUtils.java:276)
> 	at org.apache.hadoop.hbase.util.MetaUtils.scanMetaRegion(MetaUtils.java:261)
> 	at org.apache.hadoop.hbase.util.Merge.run(Merge.java:115)
> 	at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
> 	at org.apache.hadoop.hbase.util.Merge.main(Merge.java:379)

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira