[jira] [Commented] (HBASE-15381) Implement a distributed MOB compaction by procedure

["Jean-Marc Spaggiari (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/HBASE-15381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16338934#comment-16338934 ] 

Jean-Marc Spaggiari commented on HBASE-15381:
---------------------------------------------

[~jmhsieh] [~stack] [~jingcheng.du@intel.com] guys any chance to see that done soon? Just looking at a cluster where 90% of the workload is MOBs and compaction designed on the master sounds a bit strange. When you add servers or lost servers and need to get back locality, etc.

> Implement a distributed MOB compaction by procedure
> ---------------------------------------------------
>
>                 Key: HBASE-15381
>                 URL: https://issues.apache.org/jira/browse/HBASE-15381
>             Project: HBase
>          Issue Type: Improvement
>          Components: mob
>            Reporter: Jingcheng Du
>            Assignee: Jingcheng Du
>            Priority: Major
>         Attachments: HBASE-15381-v2.patch, HBASE-15381-v3.patch, HBASE-15381-v4.patch, HBASE-15381-v5.patch, HBASE-15381-v6.patch, HBASE-15381.patch, mob distributed compaction design-v2.pdf, mob distributed compaction design.pdf
>
>
> In MOB, there is a periodical compaction which runs in HMaster (It can be disabled by configuration), some small mob files are merged into bigger ones. Now the compaction only runs in HMaster which is not efficient and might impact the running of HMaster. In this JIRA, a distributed MOB compaction is introduced, it is triggered by HMaster, but all the compaction jobs are distributed to HRegionServers.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)