You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hbase.apache.org by "ramkrishna.s.vasudevan (Jira)" <ji...@apache.org> on 2020/09/17 05:50:00 UTC

[jira] [Commented] (HBASE-25015) PerformanceEvaluation with presplit randomWrite test has severe hotspotting

    [ https://issues.apache.org/jira/browse/HBASE-25015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17197396#comment-17197396 ] 

ramkrishna.s.vasudevan commented on HBASE-25015:
------------------------------------------------

[~ndimiduk]
I am trying for randomWrites on a 3 nodes cluster with 2 PE clients each 20 threads - each PE works on 2 different tables each with 200 presplits . Seems the request per sec is evenly distributed. The cluster is based on 2.1 though. 

> PerformanceEvaluation with presplit randomWrite test has severe hotspotting
> ---------------------------------------------------------------------------
>
>                 Key: HBASE-25015
>                 URL: https://issues.apache.org/jira/browse/HBASE-25015
>             Project: HBase
>          Issue Type: Bug
>          Components: test
>    Affects Versions: 2.3.1
>            Reporter: Nick Dimiduk
>            Priority: Major
>
> I'm attempting to apply a load to a small distributed cluster (12 RS). I use {{-presplit}} and specify 3 regions per region server. {{randomWrite}} test with {{-nomapred}} and 30 client threads. The result is severe hot-spotting on a single region region (10's of thousands of reqs/sec) and minimal load (high 10's to low 100's reqs/sec) to the others. It seems the split algorithm and the load generator do not agree on an even data distribution.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)