You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hbase.apache.org by "feng xu (JIRA)" <ji...@apache.org> on 2011/07/21 10:48:57 UTC
[jira] [Created] (HBASE-4122) improve hbck tool to fix .META. hole
issue.
improve hbck tool to fix .META. hole issue.
-------------------------------------------
Key: HBASE-4122
URL: https://issues.apache.org/jira/browse/HBASE-4122
Project: HBase
Issue Type: Improvement
Reporter: feng xu
Fix For: 0.92.0
hbase hbck tool can check the META hole, but it can not fix this problem by --fix.
I plan to improve the tool.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-4122) improve hbck tool to fix .META.
hole issue.
Posted by "Jieshan Bean (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-4122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13069365#comment-13069365 ]
Jieshan Bean commented on HBASE-4122:
-------------------------------------
Two suggestions about the patch:
1. I think change the method name of "HoleFixer" to "holeFixer" is better.
2. About way of traverse the map, I think the following method is a time-consuming:
{noformat}
Iterator it = regionInfo.keySet().iterator();
+ String key = null;
+ HbckInfo value = null;
+ HTableDescriptor talbeDescRight = tempRegioninfo.metaEntry.getTableDesc();
+ byte[] leftEndKey = leftRegionInfo == null ? HConstants.EMPTY_BYTE_ARRAY
+ : leftRegionInfo.metaEntry.getEndKey();
+ byte[] rightStartKey = rightRegionInfo == null ? HConstants.EMPTY_BYTE_ARRAY
+ : rightRegionInfo.metaEntry.getStartKey();
+
+ while (it.hasNext()) {
+ key = (String) it.next();
+ value = regionInfo.get(key);
+ if (value == null
+ || value.regionInfoFromRSOrHDFS == null
+ || talbeDescRight.compareTo(value.regionInfoFromRSOrHDFS
+ .getTableDesc()) != 0) {
+ continue;
+ }
+
+ // true if the region(in RS or in HDFS) that the key range is overlap with
+ // the hole range
+ if (isOverChain(value.regionInfoFromRSOrHDFS, leftEndKey, rightStartKey)) {
+ weaveHoleList.add(value);
+ }
+ }
{noformat}
I think the following method to traverse a map is better:
{noformat}
for(Map.Entry<String, HbckInfo> entry:
regionInfo.entrySet()) {
........
}
{noformat}
> improve hbck tool to fix .META. hole issue.
> -------------------------------------------
>
> Key: HBASE-4122
> URL: https://issues.apache.org/jira/browse/HBASE-4122
> Project: HBase
> Issue Type: Improvement
> Reporter: feng xu
> Fix For: 0.92.0
>
> Attachments: HBASE-4122.patch
>
>
> hbase hbck tool can check the META hole, but it can not fix this problem by --fix.
> I plan to improve the tool.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HBASE-4122) improve hbck tool to fix .META. hole
issue.
Posted by "stack (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-4122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
stack updated HBASE-4122:
-------------------------
Attachment: check_meta.rb
This version of check_meta.rb will plug hole if it cannot find a region in the fs w/ the appropriate span. This facility needs to be integrated into hbck. Putting it here for reference.
> improve hbck tool to fix .META. hole issue.
> -------------------------------------------
>
> Key: HBASE-4122
> URL: https://issues.apache.org/jira/browse/HBASE-4122
> Project: HBase
> Issue Type: Improvement
> Reporter: feng xu
> Fix For: 0.94.0
>
> Attachments: HBASE-4122.patch, check_meta.rb
>
>
> hbase hbck tool can check the META hole, but it can not fix this problem by --fix.
> I plan to improve the tool.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-4122) improve hbck tool to fix .META.
hole issue.
Posted by "stack (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-4122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13093249#comment-13093249 ]
stack commented on HBASE-4122:
------------------------------
Here is what the added check_region.rb has different from whats in bin at mo:
{code}
pynchon-590:clean-trunk stack$ diff bin/check_meta.rb /tmp/check_meta.rb
81a82,87
> def add2meta(metatable, hri)
> p = Put.new(hri.getRegionName())
> p.add(HConstants::CATALOG_FAMILY, HConstants::REGIONINFO_QUALIFIER, Writables.getBytes(hri))
> metatable.put(p)
> end
>
102,105c108,109
< p = Put.new(hri.getRegionName())
< p.add(HConstants::CATALOG_FAMILY, HConstants::REGIONINFO_QUALIFIER, Writables.getBytes(hri))
< metatable.put(p)
< LOG.info("Plugged hole in .META. at: " + hri.toString())
---
> add2meta(metatable, hri)
> LOG.info("Plugged hole in .META. at: " + hri.toString() + " with region found in fs")
108c112,116
< return plugged
---
> return if plugged
> # No region found in fs.. so just plug the hole
> hri = HRegionInfo.new(leftEdge.getTableDesc(), leftEdge.getEndKey(), rightEdge.getStartKey());
> LOG.info("Plugged hole in .META. after: " + leftEdge.getRegionNameAsString() + " with " + hri.toString())
> add2meta(metatable, hri)
{code}
> improve hbck tool to fix .META. hole issue.
> -------------------------------------------
>
> Key: HBASE-4122
> URL: https://issues.apache.org/jira/browse/HBASE-4122
> Project: HBase
> Issue Type: Improvement
> Reporter: feng xu
> Fix For: 0.94.0
>
> Attachments: HBASE-4122.patch, check_meta.rb
>
>
> hbase hbck tool can check the META hole, but it can not fix this problem by --fix.
> I plan to improve the tool.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HBASE-4122) improve hbck tool to fix .META. hole
issue.
Posted by "Jonathan Hsieh (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-4122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jonathan Hsieh updated HBASE-4122:
----------------------------------
Component/s: hbck
> improve hbck tool to fix .META. hole issue.
> -------------------------------------------
>
> Key: HBASE-4122
> URL: https://issues.apache.org/jira/browse/HBASE-4122
> Project: HBase
> Issue Type: Improvement
> Components: hbck
> Reporter: feng xu
> Fix For: 0.94.0
>
> Attachments: HBASE-4122.patch, check_meta.rb
>
>
> hbase hbck tool can check the META hole, but it can not fix this problem by --fix.
> I plan to improve the tool.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HBASE-4122) improve hbck tool to fix .META. hole
issue.
Posted by "feng xu (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-4122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
feng xu updated HBASE-4122:
---------------------------
Fix Version/s: (was: 0.92.0)
0.94.0
> improve hbck tool to fix .META. hole issue.
> -------------------------------------------
>
> Key: HBASE-4122
> URL: https://issues.apache.org/jira/browse/HBASE-4122
> Project: HBase
> Issue Type: Improvement
> Reporter: feng xu
> Fix For: 0.94.0
>
> Attachments: HBASE-4122.patch
>
>
> hbase hbck tool can check the META hole, but it can not fix this problem by --fix.
> I plan to improve the tool.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HBASE-4122) improve hbck tool to fix .META. hole
issue.
Posted by "feng xu (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-4122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
feng xu updated HBASE-4122:
---------------------------
Attachment: HBASE-4122.patch
this patch is about how to fix a hole problem.
> improve hbck tool to fix .META. hole issue.
> -------------------------------------------
>
> Key: HBASE-4122
> URL: https://issues.apache.org/jira/browse/HBASE-4122
> Project: HBase
> Issue Type: Improvement
> Reporter: feng xu
> Fix For: 0.92.0
>
> Attachments: HBASE-4122.patch
>
>
> hbase hbck tool can check the META hole, but it can not fix this problem by --fix.
> I plan to improve the tool.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-4122) improve hbck tool to fix .META.
hole issue.
Posted by "Jonathan Hsieh (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-4122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13093416#comment-13093416 ]
Jonathan Hsieh commented on HBASE-4122:
---------------------------------------
I've noticed several "backwards" regions in a meta that I'm trying to restore that had the check_meta.rb script applied to it. I have a feeling that the hole detection algorithm that just keeps the previous region range may be too simple - and that the "backwards" hole may be caused by a recovery that misses a case.
Let's say the table has the following regions
Start -> End
A->B
A->C
B->C
I've noticed some cases where newly added regions look like this:
C->B
B->A
My guess is that a further attempt to clean this up may cause more problems.
> improve hbck tool to fix .META. hole issue.
> -------------------------------------------
>
> Key: HBASE-4122
> URL: https://issues.apache.org/jira/browse/HBASE-4122
> Project: HBase
> Issue Type: Improvement
> Reporter: feng xu
> Fix For: 0.94.0
>
> Attachments: HBASE-4122.patch, check_meta.rb
>
>
> hbase hbck tool can check the META hole, but it can not fix this problem by --fix.
> I plan to improve the tool.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Resolved] (HBASE-4122) improve hbck tool to fix .META. hole
issue.
Posted by "Jonathan Hsieh (Resolved) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-4122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jonathan Hsieh resolved HBASE-4122.
-----------------------------------
Resolution: Duplicate
Fix Version/s: (was: 0.96.0)
Assignee: Jonathan Hsieh
This problem this issue tries to fix has been subsumed by HBASE-5128
> improve hbck tool to fix .META. hole issue.
> -------------------------------------------
>
> Key: HBASE-4122
> URL: https://issues.apache.org/jira/browse/HBASE-4122
> Project: HBase
> Issue Type: Improvement
> Components: hbck
> Reporter: feng xu
> Assignee: Jonathan Hsieh
> Attachments: HBASE-4122.patch, check_meta.rb
>
>
> hbase hbck tool can check the META hole, but it can not fix this problem by --fix.
> I plan to improve the tool.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-4122) improve hbck tool to fix .META.
hole issue.
Posted by "stack (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-4122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13094872#comment-13094872 ]
stack commented on HBASE-4122:
------------------------------
For sure check_meta is looking at a gap only. Your suggestion that it broaden the scope so it make a better call sounds right Jon.
Regards the meta that you are trying to fix, if it is the one I think you are working on, here is what check_meta.rb output found which would be what it'd used doing the fixup and looking at the keys, they seem to be going from left to right in sort order rather than 'backward'... but maybe check_meta.rb --fix bungled this anyways.
{code}
11/08/19 23:41:41 WARN check_meta: hole after REGION => {NAME => 'crash_reports,b110818b10a17aa-47b8-4b3b-89e0-5c05a2110818,1313687445944.5eee164f9ccb72765d263cc98e2f5a26.', STARTKEY => 'b110818b10a17aa-47b8-4b3b-89e0-5c05a2110818', ENDKEY => 'b110818b482cd58-2690-4b59-a65b-f0bdc2110818', ENCODED => 5eee164f9ccb72765d263cc98e2f5a26, TABLE => {{NAME => 'crash_reports', MAX_FILESIZE => '1073741824', FAMILIES => [{NAME => 'flags', BLOOMFILTER => 'NONE', REPLICATION_SCOPE => '1', COMPRESSION => 'LZO', VERSIONS => '1', TTL => '2147483647', BLOCKSIZE => '65536', IN_MEMORY => 'false', BLOCKCACHE => 'true'}, {NAME => 'ids', BLOOMFILTER => 'NONE', REPLICATION_SCOPE => '1', VERSIONS => '1', COMPRESSION => 'LZO', TTL => '2147483647', BLOCKSIZE => '65536', IN_MEMORY => 'false', BLOCKCACHE => 'true'}, {NAME => 'meta_data', BLOOMFILTER => 'NONE', REPLICATION_SCOPE => '1', VERSIONS => '3', COMPRESSION => 'LZO', TTL => '2147483647', BLOCKSIZE => '65536', IN_MEMORY => 'false', BLOCKCACHE => 'true'}, {NAME => 'processed_data', BLOOMFILTER => 'NONE', REPLICATION_SCOPE => '1', COMPRESSION => 'LZO', VERSIONS => '3', TTL => '2147483647', BLOCKSIZE => '524288', IN_MEMORY => 'false', BLOCKCACHE => 'true'}, {NAME => 'raw_data', BLOOMFILTER => 'NONE', REPLICATION_SCOPE => '1', COMPRESSION => 'LZO', VERSIONS => '3', TTL => '2147483647', BLOCKSIZE => '524288', IN_MEMORY => 'false', BLOCKCACHE => 'true'}, {NAME => 'timestamps', BLOOMFILTER => 'NONE', REPLICATION_SCOPE => '1', COMPRESSION => 'LZO', VERSIONS => '1', TTL => '2147483647', BLOCKSIZE => '65536', IN_MEMORY => 'false', BLOCKCACHE => 'true'}]}}
11/08/19 23:41:46 WARN check_meta: hole after REGION => {NAME => 'crash_reports,d110818d237e63f-b236-4c89-a2c7-5f6342110818,1313685726288.99b31c552c27ed6b7fae2a05551c08f0.', STARTKEY => 'd110818d237e63f-b236-4c89-a2c7-5f6342110818', ENDKEY => 'd110818d5ae5051-df15-4ccd-b3c6-93d722110818', ENCODED => 99b31c552c27ed6b7fae2a05551c08f0, TABLE => {{NAME => 'crash_reports', MAX_FILESIZE => '1073741824', FAMILIES => [{NAME => 'flags', BLOOMFILTER => 'NONE', REPLICATION_SCOPE => '1', COMPRESSION => 'LZO', VERSIONS => '1', TTL => '2147483647', BLOCKSIZE => '65536', IN_MEMORY => 'false', BLOCKCACHE => 'true'}, {NAME => 'ids', BLOOMFILTER => 'NONE', REPLICATION_SCOPE => '1', VERSIONS => '1', COMPRESSION => 'LZO', TTL => '2147483647', BLOCKSIZE => '65536', IN_MEMORY => 'false', BLOCKCACHE => 'true'}, {NAME => 'meta_data', BLOOMFILTER => 'NONE', REPLICATION_SCOPE => '1', VERSIONS => '3', COMPRESSION => 'LZO', TTL => '2147483647', BLOCKSIZE => '65536', IN_MEMORY => 'false', BLOCKCACHE => 'true'}, {NAME => 'processed_data', BLOOMFILTER => 'NONE', REPLICATION_SCOPE => '1', COMPRESSION => 'LZO', VERSIONS => '3', TTL => '2147483647', BLOCKSIZE => '524288', IN_MEMORY => 'false', BLOCKCACHE => 'true'}, {NAME => 'raw_data', BLOOMFILTER => 'NONE', REPLICATION_SCOPE => '1', COMPRESSION => 'LZO', VERSIONS => '3', TTL => '2147483647', BLOCKSIZE => '524288', IN_MEMORY => 'false', BLOCKCACHE => 'true'}, {NAME => 'timestamps', BLOOMFILTER => 'NONE', REPLICATION_SCOPE => '1', COMPRESSION => 'LZO', VERSIONS => '1', TTL => '2147483647', BLOCKSIZE => '65536', IN_MEMORY => 'false', BLOCKCACHE => 'true'}]}}
11/08/19 23:41:46 WARN check_meta: hole after REGION => {NAME => 'crash_reports,d110818d5ae5051-df15-4ccd-b3c6-93d722110818,1313685726288.6f17c0badca9ad9d8b9cdd7734f4147f.', STARTKEY => 'd110818d5ae5051-df15-4ccd-b3c6-93d722110818', ENDKEY => 'd110818d926b2f0-1620-4c00-b057-5bddf2110818', ENCODED => 6f17c0badca9ad9d8b9cdd7734f4147f, TABLE => {{NAME => 'crash_reports', MAX_FILESIZE => '1073741824', FAMILIES => [{NAME => 'flags', BLOOMFILTER => 'NONE', REPLICATION_SCOPE => '1', COMPRESSION => 'LZO', VERSIONS => '1', TTL => '2147483647', BLOCKSIZE => '65536', IN_MEMORY => 'false', BLOCKCACHE => 'true'}, {NAME => 'ids', BLOOMFILTER => 'NONE', REPLICATION_SCOPE => '1', VERSIONS => '1', COMPRESSION => 'LZO', TTL => '2147483647', BLOCKSIZE => '65536', IN_MEMORY => 'false', BLOCKCACHE => 'true'}, {NAME => 'meta_data', BLOOMFILTER => 'NONE', REPLICATION_SCOPE => '1', VERSIONS => '3', COMPRESSION => 'LZO', TTL => '2147483647', BLOCKSIZE => '65536', IN_MEMORY => 'false', BLOCKCACHE => 'true'}, {NAME => 'processed_data', BLOOMFILTER => 'NONE', REPLICATION_SCOPE => '1', COMPRESSION => 'LZO', VERSIONS => '3', TTL => '2147483647', BLOCKSIZE => '524288', IN_MEMORY => 'false', BLOCKCACHE => 'true'}, {NAME => 'raw_data', BLOOMFILTER => 'NONE', REPLICATION_SCOPE => '1', COMPRESSION => 'LZO', VERSIONS => '3', TTL => '2147483647', BLOCKSIZE => '524288', IN_MEMORY => 'false', BLOCKCACHE => 'true'}, {NAME => 'timestamps', BLOOMFILTER => 'NONE', REPLICATION_SCOPE => '1', COMPRESSION => 'LZO', VERSIONS => '1', TTL => '2147483647', BLOCKSIZE => '65536', IN_MEMORY => 'false', BLOCKCACHE => 'true'}]}}
11/08/19 23:41:46 WARN check_meta: hole after REGION => {NAME => 'crash_reports,d110818d926b2f0-1620-4c00-b057-5bddf2110818,1313686340717.4a55c090329a685d18c03d91483dd9e4.', STARTKEY => 'd110818d926b2f0-1620-4c00-b057-5bddf2110818', ENDKEY => 'd110818dc9dcf1c-77cd-4d8d-907e-5f5902110818', ENCODED => 4a55c090329a685d18c03d91483dd9e4, TABLE => {{NAME => 'crash_reports', MAX_FILESIZE => '1073741824', FAMILIES => [{NAME => 'flags', BLOOMFILTER => 'NONE', REPLICATION_SCOPE => '1', COMPRESSION => 'LZO', VERSIONS => '1', TTL => '2147483647', BLOCKSIZE => '65536', IN_MEMORY => 'false', BLOCKCACHE => 'true'}, {NAME => 'ids', BLOOMFILTER => 'NONE', REPLICATION_SCOPE => '1', VERSIONS => '1', COMPRESSION => 'LZO', TTL => '2147483647', BLOCKSIZE => '65536', IN_MEMORY => 'false', BLOCKCACHE => 'true'}, {NAME => 'meta_data', BLOOMFILTER => 'NONE', REPLICATION_SCOPE => '1', VERSIONS => '3', COMPRESSION => 'LZO', TTL => '2147483647', BLOCKSIZE => '65536', IN_MEMORY => 'false', BLOCKCACHE => 'true'}, {NAME => 'processed_data', BLOOMFILTER => 'NONE', REPLICATION_SCOPE => '1', COMPRESSION => 'LZO', VERSIONS => '3', TTL => '2147483647', BLOCKSIZE => '524288', IN_MEMORY => 'false', BLOCKCACHE => 'true'}, {NAME => 'raw_data', BLOOMFILTER => 'NONE', REPLICATION_SCOPE => '1', COMPRESSION => 'LZO', VERSIONS => '3', TTL => '2147483647', BLOCKSIZE => '524288', IN_MEMORY => 'false', BLOCKCACHE => 'true'}, {NAME => 'timestamps', BLOOMFILTER => 'NONE', REPLICATION_SCOPE => '1', COMPRESSION => 'LZO', VERSIONS => '1', TTL => '2147483647', BLOCKSIZE => '65536', IN_MEMORY => 'false', BLOCKCACHE => 'true'}]}}
11/08/19 23:41:46 WARN check_meta: hole after REGION => {NAME => 'crash_reports,d110818dc9dcf1c-77cd-4d8d-907e-5f5902110818,1313725142834.938f334ca6399ce5a17d33dc1a045d8d.', STARTKEY => 'd110818dc9dcf1c-77cd-4d8d-907e-5f5902110818', ENDKEY => 'd110818de521594-7a61-4e3a-8332-155db2110818', ENCODED => 938f334ca6399ce5a17d33dc1a045d8d, TABLE => {{NAME => 'crash_reports', MAX_FILESIZE => '1073741824', FAMILIES => [{NAME => 'flags', BLOOMFILTER => 'NONE', REPLICATION_SCOPE => '1', VERSIONS => '1', COMPRESSION => 'LZO', TTL => '2147483647', BLOCKSIZE => '65536', IN_MEMORY => 'false', BLOCKCACHE => 'true'}, {NAME => 'ids', BLOOMFILTER => 'NONE', REPLICATION_SCOPE => '1', COMPRESSION => 'LZO', VERSIONS => '1', TTL => '2147483647', BLOCKSIZE => '65536', IN_MEMORY => 'false', BLOCKCACHE => 'true'}, {NAME => 'meta_data', BLOOMFILTER => 'NONE', REPLICATION_SCOPE => '1', COMPRESSION => 'LZO', VERSIONS => '3', TTL => '2147483647', BLOCKSIZE => '65536', IN_MEMORY => 'false', BLOCKCACHE => 'true'}, {NAME => 'processed_data', BLOOMFILTER => 'NONE', REPLICATION_SCOPE => '1', VERSIONS => '3', COMPRESSION => 'LZO', TTL => '2147483647', BLOCKSIZE => '524288', IN_MEMORY => 'false', BLOCKCACHE => 'true'}, {NAME => 'raw_data', BLOOMFILTER => 'NONE', REPLICATION_SCOPE => '1', VERSIONS => '3', COMPRESSION => 'LZO', TTL => '2147483647', BLOCKSIZE => '524288', IN_MEMORY => 'false', BLOCKCACHE => 'true'}, {NAME => 'timestamps', BLOOMFILTER => 'NONE', REPLICATION_SCOPE => '1', VERSIONS => '1', COMPRESSION => 'LZO', TTL => '2147483647', BLOCKSIZE => '65536', IN_MEMORY => 'false', BLOCKCACHE => 'true'}]}}
11/08/19 23:41:46 WARN check_meta: hole after REGION => {NAME => 'crash_reports,d110818dc9dcf1c-77cd-4d8d-907e-5f5902110818,1313794261476.f5804f5529388eb35a81e47256e70115.', STARTKEY => 'd110818dc9dcf1c-77cd-4d8d-907e-5f5902110818', ENDKEY => 'd110819d3fd17c7-69aa-411d-a7d7-4169b2110819', ENCODED => f5804f5529388eb35a81e47256e70115, TABLE => {{NAME => 'crash_reports', MAX_FILESIZE => '1073741824', FAMILIES => [{NAME => 'flags', BLOOMFILTER => 'NONE', REPLICATION_SCOPE => '1', COMPRESSION => 'LZO', VERSIONS => '1', TTL => '2147483647', BLOCKSIZE => '65536', IN_MEMORY => 'false', BLOCKCACHE => 'true'}, {NAME => 'ids', BLOOMFILTER => 'NONE', REPLICATION_SCOPE => '1', VERSIONS => '1', COMPRESSION => 'LZO', TTL => '2147483647', BLOCKSIZE => '65536', IN_MEMORY => 'false', BLOCKCACHE => 'true'}, {NAME => 'meta_data', BLOOMFILTER => 'NONE', REPLICATION_SCOPE => '1', VERSIONS => '3', COMPRESSION => 'LZO', TTL => '2147483647', BLOCKSIZE => '65536', IN_MEMORY => 'false', BLOCKCACHE => 'true'}, {NAME => 'processed_data', BLOOMFILTER => 'NONE', REPLICATION_SCOPE => '1', COMPRESSION => 'LZO', VERSIONS => '3', TTL => '2147483647', BLOCKSIZE => '524288', IN_MEMORY => 'false', BLOCKCACHE => 'true'}, {NAME => 'raw_data', BLOOMFILTER => 'NONE', REPLICATION_SCOPE => '1', COMPRESSION => 'LZO', VERSIONS => '3', TTL => '2147483647', BLOCKSIZE => '524288', IN_MEMORY => 'false', BLOCKCACHE => 'true'}, {NAME => 'timestamps', BLOOMFILTER => 'NONE', REPLICATION_SCOPE => '1', COMPRESSION => 'LZO', VERSIONS => '1', TTL => '2147483debug2: channel 0: window 999152 sent adjust 49424
647', BLOCKSIZE => '65536', IN_MEMORY => 'false', BLOCKCACHE => 'true'}]}}
orts', MAX_FILESIZE => '1073741824', FAMILIES => [{NAME => 'flags', BLOOMFILTER => 'NONE', REPLICATION_SCOPE => '1', VERSIONS => '1', COMPRESSION => 'LZO', TTL => '2147483647', BLOCKSIZE => '65536', IN_MEMORY => 'false', BLOCKCACHE => 'true'}, {NAME => 'ids', BLOOMFILTER => 'NONE', REPLICATION_SCOPE => '1', COMPRESSION => 'LZO', VERSIONS => '1', TTL => '2147483647', BLOCKSIZE => '65536', IN_MEMORY => 'false', BLOCKCACHE => 'true'}, {NAME => 'meta_data', BLOOMFILTER => 'NONE', REPLICATION_SCOPE => '1', COMPRESSION => 'LZO', VERSIONS => '3', TTL => '2147483647', BLOCKSIZE => '65536', IN_MEMORY => 'false', BLOCKCACHE => 'true'}, {NAME => 'processed_data', BLOOMFILTER => 'NONE', REPLICATION_SCOPE => '1', VERSIONS => '3', COMPRESSION => 'LZO', TTL => '2147483647', BLOCKSIZE => '524288', IN_MEMORY => 'false', BLOCKCACHE => 'true'}, {NAME => 'raw_data', BLOOMFILTER => 'NONE', REPLICATION_SCOPE => '1', VERSIONS => '3', COMPRESSION => 'LZO', TTL => '2147483647', BLOCKSIZE => '524288', IN_MEMORY => 'false', BLOCKCACHE => 'true'}, {NAME => 'timestamps', BLOOMFILTER => 'NONE', REPLICATION_SCOPE => '1', VERSIONS => '1', COMPRESSION => 'LZO', TTL => '2147483647', BLOCKSIZE => '65536', IN_MEMORY => 'false', BLOCKCACHE => 'true'}]}}
{code}
> improve hbck tool to fix .META. hole issue.
> -------------------------------------------
>
> Key: HBASE-4122
> URL: https://issues.apache.org/jira/browse/HBASE-4122
> Project: HBase
> Issue Type: Improvement
> Reporter: feng xu
> Fix For: 0.94.0
>
> Attachments: HBASE-4122.patch, check_meta.rb
>
>
> hbase hbck tool can check the META hole, but it can not fix this problem by --fix.
> I plan to improve the tool.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-4122) improve hbck tool to fix .META.
hole issue.
Posted by "feng xu (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-4122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13070282#comment-13070282 ]
feng xu commented on HBASE-4122:
--------------------------------
thanks jieshan,
I will update the patch.
anyone can suggest me something about the META table hole problem?
> improve hbck tool to fix .META. hole issue.
> -------------------------------------------
>
> Key: HBASE-4122
> URL: https://issues.apache.org/jira/browse/HBASE-4122
> Project: HBase
> Issue Type: Improvement
> Reporter: feng xu
> Fix For: 0.92.0
>
> Attachments: HBASE-4122.patch
>
>
> hbase hbck tool can check the META hole, but it can not fix this problem by --fix.
> I plan to improve the tool.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HBASE-4122) improve hbck tool to fix .META. hole
issue.
Posted by "Lars Hofhansl (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-4122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Lars Hofhansl updated HBASE-4122:
---------------------------------
Fix Version/s: (was: 0.94.0)
0.96.0
Pushing to 0.96.
> improve hbck tool to fix .META. hole issue.
> -------------------------------------------
>
> Key: HBASE-4122
> URL: https://issues.apache.org/jira/browse/HBASE-4122
> Project: HBase
> Issue Type: Improvement
> Components: hbck
> Reporter: feng xu
> Fix For: 0.96.0
>
> Attachments: HBASE-4122.patch, check_meta.rb
>
>
> hbase hbck tool can check the META hole, but it can not fix this problem by --fix.
> I plan to improve the tool.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira