You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@hbase.apache.org by "Andrew Purtell (JIRA)" <ji...@apache.org> on 2019/02/01 20:24:01 UTC

[jira] [Updated] (HBASE-20545) Improve performance of BaseLoadBalancer.retainAssignment

     [ https://issues.apache.org/jira/browse/HBASE-20545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Andrew Purtell updated HBASE-20545:
-----------------------------------
    Fix Version/s:     (was: 1.5.0)

> Improve performance of BaseLoadBalancer.retainAssignment
> --------------------------------------------------------
>
>                 Key: HBASE-20545
>                 URL: https://issues.apache.org/jira/browse/HBASE-20545
>             Project: HBase
>          Issue Type: Improvement
>          Components: Balancer
>    Affects Versions: 1.4.4, 2.0.0
>            Reporter: Thiruvel Thirumoolan
>            Assignee: Thiruvel Thirumoolan
>            Priority: Major
>             Fix For: 3.0.0, 2.1.0, 1.3.3, 1.4.5
>
>         Attachments: HBASE-20545.branch-1.4.001.patch, HBASE-20545.branch-1.4.002.patch, HBASE-20545.branch-2.001.patch
>
>
> I was measuring perf at scale with a 1m region table and noticed some improvements can be made to BaseLoadBalancer.retainAssignment().
> retainAssignment() spends a few mins to enable a 1m regions table and also generates a lot of objects unnecessarily. This jira is to make the most common case go faster with very minimal changes. A slightly modified version of this patch takes about 5 seconds for a 1m region table ignoring the time spent in createCluster(). I think locality can be refreshed during master startup in different ways without taking time in retainAssignment, but will follow up on that in subsequent jiras. Leaving it untouched here, but wanted to call out the time taken without that method.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)