You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@hbase.apache.org by "Jonathan Hsieh (JIRA)" <ji...@apache.org> on 2014/01/22 21:15:19 UTC

[jira] [Created] (HBASE-10401) [hbck] perform overlap group merges in parallel

Jonathan Hsieh created HBASE-10401:
--------------------------------------

             Summary: [hbck] perform overlap group merges in parallel
                 Key: HBASE-10401
                 URL: https://issues.apache.org/jira/browse/HBASE-10401
             Project: HBase
          Issue Type: Bug
          Components: hbck
    Affects Versions: 0.96.1.1, 0.94.16, 0.92.2, 0.98.0, 0.99.0
            Reporter: Jonathan Hsieh
            Assignee: Jonathan Hsieh


In a recent support case, we encountered a corrupt hbase that had thousands of "overlap groups" (regions that had overlapping key ranges).  The current implementation repairs these by serially taking a group, perorming a merge and then moving on to the next group.  Because assignments and hdfs nn operations are involved each merge could take on the order of seconds.  With thousands of overlap groups, this could take hours to complete.

This patch makes it so that these independent merge groups are merged in parallel.  It uses the same thread pool for other fs info-gathering operations.



--
This message was sent by Atlassian JIRA
(v6.1.5#6160)