You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hbase.apache.org by "Nick Dimiduk (Jira)" <ji...@apache.org> on 2020/09/11 17:19:00 UTC
[jira] [Updated] (HBASE-25015) PerformanceEvaluation with presplit
randomWrite test has severe hotspotting
[ https://issues.apache.org/jira/browse/HBASE-25015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Nick Dimiduk updated HBASE-25015:
---------------------------------
Description: I'm attempting to apply a load to a small distributed cluster (12 RS). I use {{-presplit}} and specify 3 regions per region server. {{randomWrite}} test with {{-nomapred}} and 30 client threads. The result is severe hot-spotting on a single region region (10's of thousands of reqs/sec) and minimal load (high 10's to low 100's reqs/sec) to the others. It seems the split algorithm and the load generator do not agree on an even data distribution. (was: I'm attempting to apply a load to a small distributed cluster (12 RS). I use {{--presplit}} and specify 3 regions per region server. {{randomWrite}} test with {{--nomapred}} and 30 client threads. The result is severe hot-spotting on a single region region (10's of thousands of reqs/sec) and minimal load (high 10's to low 100's reqs/sec) to the others. It seems the split algorithm and the load generator do not agree on an even data distribution.)
> PerformanceEvaluation with presplit randomWrite test has severe hotspotting
> ---------------------------------------------------------------------------
>
> Key: HBASE-25015
> URL: https://issues.apache.org/jira/browse/HBASE-25015
> Project: HBase
> Issue Type: Bug
> Components: test
> Affects Versions: 2.3.1
> Reporter: Nick Dimiduk
> Priority: Major
>
> I'm attempting to apply a load to a small distributed cluster (12 RS). I use {{-presplit}} and specify 3 regions per region server. {{randomWrite}} test with {{-nomapred}} and 30 client threads. The result is severe hot-spotting on a single region region (10's of thousands of reqs/sec) and minimal load (high 10's to low 100's reqs/sec) to the others. It seems the split algorithm and the load generator do not agree on an even data distribution.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)