You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hbase.apache.org by "Michael Stack (Jira)" <ji...@apache.org> on 2020/06/16 18:52:00 UTC
[jira] [Comment Edited] (HBASE-20610) Procedure V2 - Distributed
Log Splitting
[ https://issues.apache.org/jira/browse/HBASE-20610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17137850#comment-17137850 ]
Michael Stack edited comment on HBASE-20610 at 6/16/20, 6:51 PM:
-----------------------------------------------------------------
[~tianjingyun] Should we resolve this? Seems to basically work (I added a subtask w/ some cleanup.... A review would be appreciated if you have a moment... thanks).
Also, the fix version doesn't seem correct. It says 3.0x but it seems like it got backported to branch-2 and branch-2.3? We should update the fix version? Thanks.
was (Author: stack):
[~tianjingyun] Should we resolve this? Seems to basically work (I added a subtask w/ some cleanup.... A review would be appreciated if you have a moment... thanks).
> Procedure V2 - Distributed Log Splitting
> ----------------------------------------
>
> Key: HBASE-20610
> URL: https://issues.apache.org/jira/browse/HBASE-20610
> Project: HBase
> Issue Type: Umbrella
> Components: proc-v2
> Reporter: Guanghao Zhang
> Assignee: Jingyun Tian
> Priority: Major
> Fix For: 3.0.0-alpha-1
>
> Attachments: HBASE-20610.master.001.patch
>
>
> Now master and regionserver use zk to coordinate log split tasks. The split log manager manages all log files which need to be scanned and split. Then the split log manager places all the logs into the ZooKeeper splitWAL node (/hbase/splitWAL) as tasks and monitors these task nodes and waits for them to be processed. Each regionserver watch splitWAL znode and grab task when node children changed. And regionserver does the work to split the logs.
> Open this umbrella issue to move this "coordinate" work to use new procedure v2 framework and reduce zk depencency. Plan to finish this before 3.0 release. Any suggestions are welcomed. Thanks.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)