You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hbase.apache.org by "ramkrishna.s.vasudevan (Jira)" <ji...@apache.org> on 2020/09/17 05:50:00 UTC
[jira] [Commented] (HBASE-25015) PerformanceEvaluation with
presplit randomWrite test has severe hotspotting
[ https://issues.apache.org/jira/browse/HBASE-25015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17197396#comment-17197396 ]
ramkrishna.s.vasudevan commented on HBASE-25015:
------------------------------------------------
[~ndimiduk]
I am trying for randomWrites on a 3 nodes cluster with 2 PE clients each 20 threads - each PE works on 2 different tables each with 200 presplits . Seems the request per sec is evenly distributed. The cluster is based on 2.1 though.
> PerformanceEvaluation with presplit randomWrite test has severe hotspotting
> ---------------------------------------------------------------------------
>
> Key: HBASE-25015
> URL: https://issues.apache.org/jira/browse/HBASE-25015
> Project: HBase
> Issue Type: Bug
> Components: test
> Affects Versions: 2.3.1
> Reporter: Nick Dimiduk
> Priority: Major
>
> I'm attempting to apply a load to a small distributed cluster (12 RS). I use {{-presplit}} and specify 3 regions per region server. {{randomWrite}} test with {{-nomapred}} and 30 client threads. The result is severe hot-spotting on a single region region (10's of thousands of reqs/sec) and minimal load (high 10's to low 100's reqs/sec) to the others. It seems the split algorithm and the load generator do not agree on an even data distribution.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)