You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@hbase.apache.org by "Guanghao Zhang (JIRA)" <ji...@apache.org> on 2018/05/22 03:49:00 UTC

[jira] [Created] (HBASE-20610) Procedure V2 - Distributed Log Splitting

Guanghao Zhang created HBASE-20610:
--------------------------------------

             Summary: Procedure V2 - Distributed Log Splitting
                 Key: HBASE-20610
                 URL: https://issues.apache.org/jira/browse/HBASE-20610
             Project: HBase
          Issue Type: Umbrella
          Components: proc-v2
            Reporter: Guanghao Zhang
             Fix For: 3.0.0


Now master and regionserver use zk to coordinate log split tasks. The split log manager manages all log files which need to be scanned and split. Then the split log manager places all the logs into the ZooKeeper splitWAL node (/hbase/splitWAL) as tasks and monitors these task nodes and waits for them to be processed. Each regionserver watch splitWAL znode and grab task when node children changed. And regionserver does the work to split the logs.

Open this umbrella issue to move this "coordinate" work to use new procedure v2 framework and reduce zk depencency. Plan to finish this before 3.0 release. Any suggestions are welcomed. Thanks.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)