You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hbase.apache.org by "Yun Zhao (JIRA)" <ji...@apache.org> on 2017/11/10 16:19:00 UTC
[jira] [Updated] (HBASE-19226) Limit the reduce tasks number of
incremental load
[ https://issues.apache.org/jira/browse/HBASE-19226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Yun Zhao updated HBASE-19226:
-----------------------------
Attachment: HBASE-19226.master.001.patch
> Limit the reduce tasks number of incremental load
> -------------------------------------------------
>
> Key: HBASE-19226
> URL: https://issues.apache.org/jira/browse/HBASE-19226
> Project: HBase
> Issue Type: Improvement
> Reporter: Yun Zhao
> Priority: Minor
> Attachments: HBASE-19226.master.001.patch
>
>
> When using MapReduce job to perform an incremental load into a table,the number of reduce tasks is the current number of regions. If there are too many regions, will lead to network+disk I/O is too large, affecting the real-time request.
> Need to use a configuration to set a number or ratio?
> Limit running reduce tasks since [https://issues.apache.org/jira/browse/MAPREDUCE-5583], the old version can only be set reduce number.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)