[jira] [Created] (HBASE-26023) Overhaul of test cluster set up for table skew

["Clara Xiong (Jira)" <ji...@apache.org>]

Clara Xiong created HBASE-26023:
-----------------------------------

             Summary: Overhaul of test cluster set up for table skew
                 Key: HBASE-26023
                 URL: https://issues.apache.org/jira/browse/HBASE-26023
             Project: HBase
          Issue Type: Sub-task
          Components: Balancer, test
         Environment: There is another bug in the original tableSkew cost function for aggregation of the cost per table:

If we have 10 regions, one per table, evenly distributed on 10 nodes, the cost is scale to 1.0.

The more tables we have, the closer the value will be to 1.0. The cost function becomes useless.

All the balancer tests were set up with large numbers of tables with minimal regions per table. This artificially inflates the total cost and trigger balancer runs. With this fix on TableSkewFunction, we need to overhaul the tests too. We also need to add tests that reflect more diversified scenarios for table distribution such as large tables with large numbers of regions.
{code:java}
protected double cost() {
 double max = cluster.numRegions;
 double min = ((double) cluster.numRegions) / cluster.numServers;
 double value = 0;

 for (int i = 0; i < cluster.numMaxRegionsPerTable.length; i++) {
 value += cluster.numMaxRegionsPerTable[i];
 }
 LOG.info("min = {}, max = {}, cost= {}", min, max, value);
 return scale(min, max, value);
 }
}{code}
            Reporter: Clara Xiong






--
This message was sent by Atlassian Jira
(v8.3.4#803005)