[jira] [Comment Edited] (HBASE-23634) Enable "Split WAL to HFile" by default

["Bo Cui (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/HBASE-23634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17160327#comment-17160327 ] 

Bo Cui edited comment on HBASE-23634 at 7/18/20, 4:01 AM:
----------------------------------------------------------

1、before compaction, large number of small hfiles affect read and write performance of region


2、a hfile needs 3 NN RPCs to bulkload during openRegion(validate、rename、createReader)


if bulkLoadService ThreadNum is 3, and hfiles is 20(because wal number is 20), and RS is 100, region is 2K*100, and openRegion thread is 75


so hbase needs 3*3*75*100 concurrent NN RPCs and needs 3*20*2K*100 total NN RPCs

 


was (Author: bo cui):
1、before compaction, large number of small hfiles affect read and write performance of region


2、a hfile needs 3 NN RPCs to bulkload during openRegion(validate、rename、createReader)


if bulkLoadService ThreadNum is 3, and hfiles is 20(because wal number is 20), and RS is 100, region is 2K*100, and openRegion thread is 75


so hbase needs 3*3*75*100 concurrent NN RPCs and needs 3*20*2K*100 NN total NN RPCs

 

> Enable "Split WAL to HFile" by default
> --------------------------------------
>
>                 Key: HBASE-23634
>                 URL: https://issues.apache.org/jira/browse/HBASE-23634
>             Project: HBase
>          Issue Type: Task
>    Affects Versions: 3.0.0-alpha-1, 2.3.0
>            Reporter: Guanghao Zhang
>            Priority: Blocker
>             Fix For: 3.0.0-alpha-1, 2.4.0
>
>




--
This message was sent by Atlassian Jira
(v8.3.4#803005)