You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hbase.apache.org by "terry zhang (JIRA)" <ji...@apache.org> on 2013/08/14 12:40:47 UTC
[jira] [Commented] (HBASE-9214) CatalogJanitor delete region info
in Meta during Restore snapshot
[ https://issues.apache.org/jira/browse/HBASE-9214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13739503#comment-13739503 ]
terry zhang commented on HBASE-9214:
------------------------------------
Below is some log during testing :
1. CatalogJanitor decide to delete region
2013-08-13 16:19:34,268 WARN org.apache.hadoop.hbase.master.CatalogJanitor: Daughter regiondir does not exist: hdfs://dw77.kgb.sqa.c
m4:9900/hbase-test3-snap/writetest/b95023663816ecf208f7ee3d69d8fb9c
2013-08-13 16:19:34,268 WARN org.apache.hadoop.hbase.master.CatalogJanitor: Daughter regiondir does not exist: hdfs://dw77.kgb.sqa.c
m4:9900/hbase-test3-snap/writetest/1c47cf89406349c159f36ae2e0c55582
2013-08-13 16:19:34,268 DEBUG org.apache.hadoop.hbase.master.CatalogJanitor: Deleting region writetest,P7777777777777777777777777777
777777777777777777773,1376370447956.bce523f334ca2c78f2c4ad360dc2a6a4. because daughter splits no longer hold references
2 . RestoreSnapshotHelper insert region info to META
2013-08-13 16:19:34,273 DEBUG org.apache.hadoop.hbase.catalog.MetaEditor: Add to META, regions: [{NAME => 'writetest,HZZZZZZZZZZZZZZ
ZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZX,1376370447956.05a9a252b41e8e41aa3a6a8a797380ab.', STARTKEY => 'HZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZ
ZZZZZZZZZZZZZZZZX', ENDKEY => 'LLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLI', ENCODED => 05a9a252b41e8e41aa3a6a8a797380ab,}, {
NAME => 'writetest,3LLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLL,1376370447956.5689d3dbc9dc97106c28945ab7bb5104.', STARTKEY =>
'3LLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLL', ENDKEY => '77777777777777777777777777777777777777777777777776', ENCODED => 568
9d3dbc9dc97106c28945ab7bb5104,}, {NAME => 'writetest,77777777777777777777777777777777777777777777777776,1376370447956.5b5a7331c26ead
c41ea2944939fd2cee.', STARTKEY => '77777777777777777777777777777777777777777777777776', ENDKEY => 'ASSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS
SSSSSSSSSSSSSSSSR', ENCODED => 5b5a7331c26eadc41ea2944939fd2cee,}, {NAME => 'writetest,ASSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS
SSSSR,1376370447956.60226c1fbedc9d98f1192e37d7d3b6af.', STARTKEY => 'ASSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSR', ENDKEY =>
'EEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEC', ENCODED => 60226c1fbedc9d98f1192e37d7d3b6af,}, {NAME => 'writetest,LLLLLLLLLLL
LLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLI,1376370447956.70523ec9e600da52b18caa45cf76cf66.', STARTKEY => 'LLLLLLLLLLLLLLLLLLLLLLLLLLLLL
LLLLLLLLLLLLLLLLLLLLI', ENDKEY => 'P7777777777777777777777777777777777777777777777773', ENCODED => 70523ec9e600da52b18caa45cf76cf66,
}, {NAME => 'writetest,SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSO,1376370447956.74f9eef1cbb3e4f6627ee39a0996dec8.', STARTKEY
=> 'SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSO', ENDKEY => 'WEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEE9', ENCODED =>
74f9eef1cbb3e4f6627ee39a0996dec8,}, {NAME => 'writetest,WEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEE9,1376370447956.82cf586c79
382a89508c3325304904f3.', STARTKEY => 'WEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEE9', ENDKEY => '', ENCODED => 82cf586c79382a8
9508c3325304904f3,}, {NAME => 'writetest,P7777777777777777777777777777777777777777777777773,1
376370447956.bce523f334ca2c78f2c4ad360d
c2a6a4.', STARTKEY => 'P7777777777777777777777777777777777777777777777773', ENDKEY => 'SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS
SSSSO', ENCODED => bce523f334ca2c78f2c4ad360dc2a6a4,}, {NAME => 'writetest,,1376370447944.d3eb975033a94730c88bf6696a413e9e.', STARTK
EY => '', ENDKEY => '3LLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLL', ENCODED => d3eb975033a94730c88bf6696a413e9e,}, {NAME => 'w
ritetest,EEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEC,1376370447956.f03a2b6805852c00e4fe029f3a9e7261.', STARTKEY => 'EEEEEEEEE
EEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEC', ENDKEY => 'HZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZX', ENCODED => f03a2b6805852
c00e4fe029f3a9e7261,}]
3. region info is delete by CatalogJanitor
2013-08-13 16:19:34,333 INFO org.apache.hadoop.hbase.catalog.MetaEditor: Deleted region writetest,P777777777777777777777777777777777
7777777777777773,1376370447956.bce523f334ca2c78f2c4ad360dc2a6a4. from META
> CatalogJanitor delete region info in Meta during Restore snapshot
> -----------------------------------------------------------------
>
> Key: HBASE-9214
> URL: https://issues.apache.org/jira/browse/HBASE-9214
> Project: HBase
> Issue Type: Bug
> Components: master
> Affects Versions: 0.94.10
> Reporter: terry zhang
>
> Today I meet a issue during restore snapshot. It can be reproduce in step below:
> 1. Table t1 create a Snapshot s1 successfully
> 2. region r1 in t1 split
> 3. CatalogJanitor Chore begin to work and found daughter do not have reference , so r1 can be deleted
> 4. restore snapshot s1 . RestoreSnapshotHelper add region r1 to meta table
> 5. CatalogJanitor delete r1 region info in meta which RestoreSnapshotHelper just inserted .
> 6. restore snapshot finished.
> Then we can found there is a hole in t1 after restore snapshot. Data loss.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira