You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hbase.apache.org by "Jingyun Tian (JIRA)" <ji...@apache.org> on 2018/11/30 10:53:00 UTC
[jira] [Updated] (HBASE-20610) Procedure V2 - Distributed Log
Splitting
[ https://issues.apache.org/jira/browse/HBASE-20610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jingyun Tian updated HBASE-20610:
---------------------------------
Attachment: HBASE-20610.master.001.patch
> Procedure V2 - Distributed Log Splitting
> ----------------------------------------
>
> Key: HBASE-20610
> URL: https://issues.apache.org/jira/browse/HBASE-20610
> Project: HBase
> Issue Type: Umbrella
> Components: proc-v2
> Reporter: Guanghao Zhang
> Priority: Major
> Fix For: 3.0.0
>
> Attachments: HBASE-20610.master.001.patch
>
>
> Now master and regionserver use zk to coordinate log split tasks. The split log manager manages all log files which need to be scanned and split. Then the split log manager places all the logs into the ZooKeeper splitWAL node (/hbase/splitWAL) as tasks and monitors these task nodes and waits for them to be processed. Each regionserver watch splitWAL znode and grab task when node children changed. And regionserver does the work to split the logs.
> Open this umbrella issue to move this "coordinate" work to use new procedure v2 framework and reduce zk depencency. Plan to finish this before 3.0 release. Any suggestions are welcomed. Thanks.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)