You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@hbase.apache.org by "Mike Drob (JIRA)" <ji...@apache.org> on 2018/06/25 21:09:01 UTC

[jira] [Commented] (HBASE-20786) Table create with thousands of regions takes too long

    [ https://issues.apache.org/jira/browse/HBASE-20786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16522820#comment-16522820 ] 

Mike Drob commented on HBASE-20786:
-----------------------------------

Does all the creation happen on master? Can it be farmed out to region servers? Is this a result of all splits needing to go through master becoming a bottleneck?

> Table create with thousands of regions takes too long
> -----------------------------------------------------
>
>                 Key: HBASE-20786
>                 URL: https://issues.apache.org/jira/browse/HBASE-20786
>             Project: HBase
>          Issue Type: Umbrella
>          Components: Performance
>            Reporter: stack
>            Priority: Major
>
> Internal testing has create of a table with 33k regions taking 18 minutes. Let me provide more info below. We have an executor with default ten threads handling the creation of the regions in HDFS which helps distribute out the load but its not enough. This cluster had >600 servers. Let me add detail.
> Need to spend some time on speeding up create/assigns. Made this an umbrella issue so can pick off pieces of the problem as subtasks.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)