You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hbase.apache.org by "Reid Chan (JIRA)" <ji...@apache.org> on 2017/11/10 09:31:00 UTC
[jira] [Commented] (HBASE-19226) Limit the reduce tasks number of
incremental load
[ https://issues.apache.org/jira/browse/HBASE-19226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16247267#comment-16247267 ]
Reid Chan commented on HBASE-19226:
-----------------------------------
I suppose it is a duplicate of HBASE-17130, do you have interest in providing a patch? [~Yun Zhao]
> Limit the reduce tasks number of incremental load
> -------------------------------------------------
>
> Key: HBASE-19226
> URL: https://issues.apache.org/jira/browse/HBASE-19226
> Project: HBase
> Issue Type: Improvement
> Reporter: Yun Zhao
> Priority: Minor
>
> When using MapReduce job to perform an incremental load into a table,the number of reduce tasks is the current number of regions. If there are too many regions, will lead to network+disk I/O is too large, affecting the real-time request.
> Need to use a configuration to set a number or ratio?
> Limit running reduce tasks since [https://issues.apache.org/jira/browse/MAPREDUCE-5583], the old version can only be set reduce number.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)