You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hbase.apache.org by "David Manning (Jira)" <ji...@apache.org> on 2021/07/10 22:54:00 UTC

[jira] [Resolved] (HBASE-22300) SLB doesn't perform well with increase in number of regions

     [ https://issues.apache.org/jira/browse/HBASE-22300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

David Manning resolved HBASE-22300.
-----------------------------------
    Resolution: Duplicate

> SLB doesn't perform well with increase in number of regions
> -----------------------------------------------------------
>
>                 Key: HBASE-22300
>                 URL: https://issues.apache.org/jira/browse/HBASE-22300
>             Project: HBase
>          Issue Type: Improvement
>          Components: Balancer
>            Reporter: Biju Nair
>            Assignee: David Manning
>            Priority: Major
>              Labels: balancer
>         Attachments: CostFromRegionLoadFunctionNew.rtf
>
>
> With increase in number of regions in a cluster the number of steps taken by balancer in 30 sec (default balancer runtime) reduces noticeably. The following is the number of steps taken with by balancer with region loads set and running it without the loads being set i.e. cost functions using region loads are not fully exercised.
> {noformat}
> Nodes  regions  Tables    # of steps           # of steps 
>                           with RS Load         With no load   
> 5       50       5        200000               200000
> 100     2000     110      104707               1000000                          
> 100     10000    40       19911                1000000                          
> 200     100000   400      870                  1000000                          {noformat}
> As one would expect the reduced number of steps also makes the balancer take long time to get to an optimal cost. Note that only 2 data points were used in the region load histogram while in practice 15 region load data points are remembered.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)