You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hbase.apache.org by "Biju Nair (JIRA)" <ji...@apache.org> on 2019/04/23 21:11:00 UTC
[jira] [Updated] (HBASE-22300) SLB doesn't perform well with
increase in number of regions
[ https://issues.apache.org/jira/browse/HBASE-22300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Biju Nair updated HBASE-22300:
------------------------------
Description:
With increase in number of regions in a cluster the number of steps taken by balancer in 30 sec (default balancer runtime) reduces noticeably. The following is the number of steps taken with by balancer with region loads set and running it without the loads being set i.e. cost functions using region loads are not fully exercised.
{noformat}
Nodes regions Tables # of steps # of steps
with RS Load With no load
5 50 5 200000 200000
100 2000 110 104707 1000000
100 10000 40 19911 1000000
200 100000 400 870 1000000 {noformat}
As one would expect the reduced number of steps also makes the balancer take long time to get to an optimal cost. Note that only 2 data points were used in the region load histogram while in practice 15 region load data points are remembered.
was:
With increase in number of regions in a cluster the number of steps taken by balancer in 30 sec (default balancer runtime) reduces noticeably. The following is the number of steps taken with by balancer with region loads set and running it without the loads being set i.e. cost functions using region loads are not fully exercised.
{noformat}
Nodes regions Tables # of steps # of steps
with RS Load With no load
5 50 5 200000 200000
100 2000 110 104707 1000000
100 10000 40 19911 1000000
200 100000 400 870 1000000 {noformat}
As one would expect the reduced number of steps also makes the balancer take long time to get to an optimal cost.
> SLB doesn't perform well with increase in number of regions
> -----------------------------------------------------------
>
> Key: HBASE-22300
> URL: https://issues.apache.org/jira/browse/HBASE-22300
> Project: HBase
> Issue Type: Improvement
> Components: Balancer
> Reporter: Biju Nair
> Priority: Major
>
> With increase in number of regions in a cluster the number of steps taken by balancer in 30 sec (default balancer runtime) reduces noticeably. The following is the number of steps taken with by balancer with region loads set and running it without the loads being set i.e. cost functions using region loads are not fully exercised.
> {noformat}
> Nodes regions Tables # of steps # of steps
> with RS Load With no load
> 5 50 5 200000 200000
> 100 2000 110 104707 1000000
> 100 10000 40 19911 1000000
> 200 100000 400 870 1000000 {noformat}
> As one would expect the reduced number of steps also makes the balancer take long time to get to an optimal cost. Note that only 2 data points were used in the region load histogram while in practice 15 region load data points are remembered.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)