You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hbase.apache.org by "stack (JIRA)" <ji...@apache.org> on 2011/08/19 21:04:27 UTC
[jira] [Created] (HBASE-4232) [hbck] Fix should be able to fill
info:regioninfo if matching region in fs
[hbck] Fix should be able to fill info:regioninfo if matching region in fs
--------------------------------------------------------------------------
Key: HBASE-4232
URL: https://issues.apache.org/jira/browse/HBASE-4232
Project: HBase
Issue Type: Improvement
Reporter: stack
Attachments: addregion.rb
On Mozilla cluster, hbck reported empty info:regioninfo but then also that there were regions in fs that were not deployed. At least one of these regions w/ an empty info:regioninfo matches to the region in fs that is not in the .META. hbck should be able to pick up the region from ms and fix the .META. entry on --fix.
{code}
Version: 0.90.1-cdh3u0
...................................................
Number of Tables: 14
Number of live region servers: 29
Number of dead region servers: 27
..Number of empty REGIONINFO_QUALIFIER rows in .META.: 10
ERROR: Region hdfs://hp-admin01.phx1.mozilla.com:8020/hbase/crash_reports/10111f37472811e5e86534790bb10e3c on HDFS, b
ut not listed in META or deployed on any region server.
ERROR: Region hdfs://hp-admin01.phx1.mozilla.com:8020/hbase/crash_reports/1bcaf00897a749ea6a0d0bf1ce709116 on HDFS, b
ut not listed in META or deployed on any region server.
ERROR: Region hdfs://hp-admin01.phx1.mozilla.com:8020/hbase/crash_reports/375913d5c0f5ed4180c0d4506c53fd1d on HDFS, b
ut not listed in META or deployed on any region server.
ERROR: Region hdfs://hp-admin01.phx1.mozilla.com:8020/hbase/crash_reports/5a1fa81ddf4bac6c7f6483d803d5cc30 on HDFS, b
ut not listed in META or deployed on any region server.
ERROR: Region hdfs://hp-admin01.phx1.mozilla.com:8020/hbase/crash_reports/6240f00ac370c186e44d189d0a52c8e7 on HDFS, b
ut not listed in META or deployed on any region server.
ERROR: Region hdfs://hp-admin01.phx1.mozilla.com:8020/hbase/crash_reports/6bd89ea69b8a4886fed3dfe93ab5e5aa on HDFS, b
ut not listed in META or deployed on any region server.
ERROR: Region hdfs://hp-admin01.phx1.mozilla.com:8020/hbase/crash_reports/716695118671df66d9d1b883f1aeae56 on HDFS, b
ut not listed in META or deployed on any region server.
ERROR: Region hdfs://hp-admin01.phx1.mozilla.com:8020/hbase/crash_reports/805ce44ef7e6aa7fa1603c422f808a3a on HDFS, b
ut not listed in META or deployed on any region server.
ERROR: Region hdfs://hp-admin01.phx1.mozilla.com:8020/hbase/crash_reports/8ed41d06b2c8e937cf460ce5e41ecbf9 on HDFS, b
ut not listed in META or deployed on any region server.
ERROR: Region hdfs://hp-admin01.phx1.mozilla.com:8020/hbase/crash_reports/8faa71d5e90aa82570df036515f752e4 on HDFS, b
ut not listed in META or deployed on any region server.
ERROR: Region hdfs://hp-admin01.phx1.mozilla.com:8020/hbase/crash_reports/938f334ca6399ce5a17d33dc1a045d8d on HDFS, b
ut not listed in META or deployed on any region server.
ERROR: Region hdfs://hp-admin01.phx1.mozilla.com:8020/hbase/crash_reports/cd673fbac6f8f88f87c81f3bdd3a1ed8 on HDFS, b
ut not listed in META or deployed on any region server.
{code}
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HBASE-4232) [hbck] Fix should be able to fill
info:regioninfo if matching region in fs
Posted by "Harsh J (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-4232?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Harsh J updated HBASE-4232:
---------------------------
Attachment: addregion.rb
Fixed script. metaTable var was not initialized.
Tested with a manual delete of info:regioninfo col, and it succeeds in adding that back.
> [hbck] Fix should be able to fill info:regioninfo if matching region in fs
> --------------------------------------------------------------------------
>
> Key: HBASE-4232
> URL: https://issues.apache.org/jira/browse/HBASE-4232
> Project: HBase
> Issue Type: Improvement
> Reporter: stack
> Attachments: addregion.rb, addregion.rb
>
>
> On Mozilla cluster, hbck reported empty info:regioninfo but then also that there were regions in fs that were not deployed. At least one of these regions w/ an empty info:regioninfo matches to the region in fs that is not in the .META. hbck should be able to pick up the region from ms and fix the .META. entry on --fix.
> {code}
> Version: 0.90.1-cdh3u0
> ...................................................
> Number of Tables: 14
> Number of live region servers: 29
> Number of dead region servers: 27
> ..Number of empty REGIONINFO_QUALIFIER rows in .META.: 10
> ERROR: Region hdfs://hp-admin01.phx1.mozilla.com:8020/hbase/crash_reports/10111f37472811e5e86534790bb10e3c on HDFS, b
> ut not listed in META or deployed on any region server.
> ERROR: Region hdfs://hp-admin01.phx1.mozilla.com:8020/hbase/crash_reports/1bcaf00897a749ea6a0d0bf1ce709116 on HDFS, b
> ut not listed in META or deployed on any region server.
> ERROR: Region hdfs://hp-admin01.phx1.mozilla.com:8020/hbase/crash_reports/375913d5c0f5ed4180c0d4506c53fd1d on HDFS, b
> ut not listed in META or deployed on any region server.
> ERROR: Region hdfs://hp-admin01.phx1.mozilla.com:8020/hbase/crash_reports/5a1fa81ddf4bac6c7f6483d803d5cc30 on HDFS, b
> ut not listed in META or deployed on any region server.
> ERROR: Region hdfs://hp-admin01.phx1.mozilla.com:8020/hbase/crash_reports/6240f00ac370c186e44d189d0a52c8e7 on HDFS, b
> ut not listed in META or deployed on any region server.
> ERROR: Region hdfs://hp-admin01.phx1.mozilla.com:8020/hbase/crash_reports/6bd89ea69b8a4886fed3dfe93ab5e5aa on HDFS, b
> ut not listed in META or deployed on any region server.
> ERROR: Region hdfs://hp-admin01.phx1.mozilla.com:8020/hbase/crash_reports/716695118671df66d9d1b883f1aeae56 on HDFS, b
> ut not listed in META or deployed on any region server.
> ERROR: Region hdfs://hp-admin01.phx1.mozilla.com:8020/hbase/crash_reports/805ce44ef7e6aa7fa1603c422f808a3a on HDFS, b
> ut not listed in META or deployed on any region server.
> ERROR: Region hdfs://hp-admin01.phx1.mozilla.com:8020/hbase/crash_reports/8ed41d06b2c8e937cf460ce5e41ecbf9 on HDFS, b
> ut not listed in META or deployed on any region server.
> ERROR: Region hdfs://hp-admin01.phx1.mozilla.com:8020/hbase/crash_reports/8faa71d5e90aa82570df036515f752e4 on HDFS, b
> ut not listed in META or deployed on any region server.
> ERROR: Region hdfs://hp-admin01.phx1.mozilla.com:8020/hbase/crash_reports/938f334ca6399ce5a17d33dc1a045d8d on HDFS, b
> ut not listed in META or deployed on any region server.
> ERROR: Region hdfs://hp-admin01.phx1.mozilla.com:8020/hbase/crash_reports/cd673fbac6f8f88f87c81f3bdd3a1ed8 on HDFS, b
> ut not listed in META or deployed on any region server.
> {code}
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HBASE-4232) [hbck] Fix should be able to fill
info:regioninfo if matching region in fs
Posted by "stack (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-4232?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
stack updated HBASE-4232:
-------------------------
Attachment: addregion.rb
Here is an add region script. You pass it .regioninfo path.
> [hbck] Fix should be able to fill info:regioninfo if matching region in fs
> --------------------------------------------------------------------------
>
> Key: HBASE-4232
> URL: https://issues.apache.org/jira/browse/HBASE-4232
> Project: HBase
> Issue Type: Improvement
> Reporter: stack
> Attachments: addregion.rb
>
>
> On Mozilla cluster, hbck reported empty info:regioninfo but then also that there were regions in fs that were not deployed. At least one of these regions w/ an empty info:regioninfo matches to the region in fs that is not in the .META. hbck should be able to pick up the region from ms and fix the .META. entry on --fix.
> {code}
> Version: 0.90.1-cdh3u0
> ...................................................
> Number of Tables: 14
> Number of live region servers: 29
> Number of dead region servers: 27
> ..Number of empty REGIONINFO_QUALIFIER rows in .META.: 10
> ERROR: Region hdfs://hp-admin01.phx1.mozilla.com:8020/hbase/crash_reports/10111f37472811e5e86534790bb10e3c on HDFS, b
> ut not listed in META or deployed on any region server.
> ERROR: Region hdfs://hp-admin01.phx1.mozilla.com:8020/hbase/crash_reports/1bcaf00897a749ea6a0d0bf1ce709116 on HDFS, b
> ut not listed in META or deployed on any region server.
> ERROR: Region hdfs://hp-admin01.phx1.mozilla.com:8020/hbase/crash_reports/375913d5c0f5ed4180c0d4506c53fd1d on HDFS, b
> ut not listed in META or deployed on any region server.
> ERROR: Region hdfs://hp-admin01.phx1.mozilla.com:8020/hbase/crash_reports/5a1fa81ddf4bac6c7f6483d803d5cc30 on HDFS, b
> ut not listed in META or deployed on any region server.
> ERROR: Region hdfs://hp-admin01.phx1.mozilla.com:8020/hbase/crash_reports/6240f00ac370c186e44d189d0a52c8e7 on HDFS, b
> ut not listed in META or deployed on any region server.
> ERROR: Region hdfs://hp-admin01.phx1.mozilla.com:8020/hbase/crash_reports/6bd89ea69b8a4886fed3dfe93ab5e5aa on HDFS, b
> ut not listed in META or deployed on any region server.
> ERROR: Region hdfs://hp-admin01.phx1.mozilla.com:8020/hbase/crash_reports/716695118671df66d9d1b883f1aeae56 on HDFS, b
> ut not listed in META or deployed on any region server.
> ERROR: Region hdfs://hp-admin01.phx1.mozilla.com:8020/hbase/crash_reports/805ce44ef7e6aa7fa1603c422f808a3a on HDFS, b
> ut not listed in META or deployed on any region server.
> ERROR: Region hdfs://hp-admin01.phx1.mozilla.com:8020/hbase/crash_reports/8ed41d06b2c8e937cf460ce5e41ecbf9 on HDFS, b
> ut not listed in META or deployed on any region server.
> ERROR: Region hdfs://hp-admin01.phx1.mozilla.com:8020/hbase/crash_reports/8faa71d5e90aa82570df036515f752e4 on HDFS, b
> ut not listed in META or deployed on any region server.
> ERROR: Region hdfs://hp-admin01.phx1.mozilla.com:8020/hbase/crash_reports/938f334ca6399ce5a17d33dc1a045d8d on HDFS, b
> ut not listed in META or deployed on any region server.
> ERROR: Region hdfs://hp-admin01.phx1.mozilla.com:8020/hbase/crash_reports/cd673fbac6f8f88f87c81f3bdd3a1ed8 on HDFS, b
> ut not listed in META or deployed on any region server.
> {code}
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Resolved] (HBASE-4232) [hbck] Fix should be able to fill
info:regioninfo if matching region in fs
Posted by "Jonathan Hsieh (Resolved) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-4232?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jonathan Hsieh resolved HBASE-4232.
-----------------------------------
Resolution: Duplicate
Assignee: Jonathan Hsieh
This is the -fixMeta option in the HBASE-5128 hbck improvements.
> [hbck] Fix should be able to fill info:regioninfo if matching region in fs
> --------------------------------------------------------------------------
>
> Key: HBASE-4232
> URL: https://issues.apache.org/jira/browse/HBASE-4232
> Project: HBase
> Issue Type: Improvement
> Reporter: stack
> Assignee: Jonathan Hsieh
> Attachments: addregion.rb, addregion.rb
>
>
> On Mozilla cluster, hbck reported empty info:regioninfo but then also that there were regions in fs that were not deployed. At least one of these regions w/ an empty info:regioninfo matches to the region in fs that is not in the .META. hbck should be able to pick up the region from ms and fix the .META. entry on --fix.
> {code}
> Version: 0.90.1-cdh3u0
> ...................................................
> Number of Tables: 14
> Number of live region servers: 29
> Number of dead region servers: 27
> ..Number of empty REGIONINFO_QUALIFIER rows in .META.: 10
> ERROR: Region hdfs://hp-admin01.phx1.mozilla.com:8020/hbase/crash_reports/10111f37472811e5e86534790bb10e3c on HDFS, b
> ut not listed in META or deployed on any region server.
> ERROR: Region hdfs://hp-admin01.phx1.mozilla.com:8020/hbase/crash_reports/1bcaf00897a749ea6a0d0bf1ce709116 on HDFS, b
> ut not listed in META or deployed on any region server.
> ERROR: Region hdfs://hp-admin01.phx1.mozilla.com:8020/hbase/crash_reports/375913d5c0f5ed4180c0d4506c53fd1d on HDFS, b
> ut not listed in META or deployed on any region server.
> ERROR: Region hdfs://hp-admin01.phx1.mozilla.com:8020/hbase/crash_reports/5a1fa81ddf4bac6c7f6483d803d5cc30 on HDFS, b
> ut not listed in META or deployed on any region server.
> ERROR: Region hdfs://hp-admin01.phx1.mozilla.com:8020/hbase/crash_reports/6240f00ac370c186e44d189d0a52c8e7 on HDFS, b
> ut not listed in META or deployed on any region server.
> ERROR: Region hdfs://hp-admin01.phx1.mozilla.com:8020/hbase/crash_reports/6bd89ea69b8a4886fed3dfe93ab5e5aa on HDFS, b
> ut not listed in META or deployed on any region server.
> ERROR: Region hdfs://hp-admin01.phx1.mozilla.com:8020/hbase/crash_reports/716695118671df66d9d1b883f1aeae56 on HDFS, b
> ut not listed in META or deployed on any region server.
> ERROR: Region hdfs://hp-admin01.phx1.mozilla.com:8020/hbase/crash_reports/805ce44ef7e6aa7fa1603c422f808a3a on HDFS, b
> ut not listed in META or deployed on any region server.
> ERROR: Region hdfs://hp-admin01.phx1.mozilla.com:8020/hbase/crash_reports/8ed41d06b2c8e937cf460ce5e41ecbf9 on HDFS, b
> ut not listed in META or deployed on any region server.
> ERROR: Region hdfs://hp-admin01.phx1.mozilla.com:8020/hbase/crash_reports/8faa71d5e90aa82570df036515f752e4 on HDFS, b
> ut not listed in META or deployed on any region server.
> ERROR: Region hdfs://hp-admin01.phx1.mozilla.com:8020/hbase/crash_reports/938f334ca6399ce5a17d33dc1a045d8d on HDFS, b
> ut not listed in META or deployed on any region server.
> ERROR: Region hdfs://hp-admin01.phx1.mozilla.com:8020/hbase/crash_reports/cd673fbac6f8f88f87c81f3bdd3a1ed8 on HDFS, b
> ut not listed in META or deployed on any region server.
> {code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira