[jira] [Commented] (HBASE-21745) Make HBCK2 be able to fix issues other than region assignment

["stack (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/HBASE-21745?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16748404#comment-16748404 ] 

stack commented on HBASE-21745:
-------------------------------

bq. Rebuild meta from region metadata in the filesystem, aka offline meta rebuild.

Has anyone ever had use for this facility in recent memory? This was always a hack dependent on possible stale schema info echo'd to the FS. It would be blind to splits and merges. I'd actually like to remove the echoing of schema to the FS -- we'd have too if we want to change the layout in the FS so we can scale.

But we could do a version for hbase2 that gave some comfort in the unlikely case we lost a whole hbase:meta.

bq. Fix assignment errors (undeployed regions, double assignments (yes, should not be possible), etc)

I've not seen double assign in hbase2. On assign, between shell and hbck2, there are a variety of toolings -- some that were not available in hbase1 such as bulk assign/unassign. I think we are covered here.

Perhaps a check on the wholesomeness of hbase:meta? hbck2 has done work in the Canary to serve this verification function. Let me take another look and see if we need to hoist up stuff from hbck1.

bq. Fix region holes, overlaps, and other errors in the region chain

Haven't seen this in amv2. Doesn't seem to happen.

bq. Fix failed split and merge transactions that have failed to roll back due to some bug (related to previous)

Yeah. Haven't seen this either.

bq. Enumerate store files to determine file level corruption and sideline corrupt files

This seems to be an hfile tool variant. Let me look into adding it.

bq. Fix hfile link problems (dangling / broken)

Ditto.

Will be back.

> Make HBCK2 be able to fix issues other than region assignment
> -------------------------------------------------------------
>
>                 Key: HBASE-21745
>                 URL: https://issues.apache.org/jira/browse/HBASE-21745
>             Project: HBase
>          Issue Type: Umbrella
>          Components: hbase-operator-tools, hbck2
>            Reporter: Duo Zhang
>            Assignee: stack
>            Priority: Critical
>
> This is what [~apurtell] posted on mailing-list, HBCK2 should support
> {quote}
>    - Rebuild meta from region metadata in the filesystem, aka offline meta
>    rebuild.
>    - Fix assignment errors (undeployed regions, double assignments (yes,
>    should not be possible), etc)
>    - Fix region holes, overlaps, and other errors in the region chain
>    - Fix failed split and merge transactions that have failed to roll back
>    due to some bug (related to previous)
>    - Enumerate store files to determine file level corruption and sideline
>    corrupt files
>    - Fix hfile link problems (dangling / broken)
> {quote}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)