You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hbase.apache.org by "Yun Zhao (JIRA)" <ji...@apache.org> on 2017/11/10 16:19:00 UTC

[jira] [Updated] (HBASE-19226) Limit the reduce tasks number of incremental load

     [ https://issues.apache.org/jira/browse/HBASE-19226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Yun Zhao updated HBASE-19226:
-----------------------------
    Attachment: HBASE-19226.master.001.patch

> Limit the reduce tasks number of incremental load
> -------------------------------------------------
>
>                 Key: HBASE-19226
>                 URL: https://issues.apache.org/jira/browse/HBASE-19226
>             Project: HBase
>          Issue Type: Improvement
>            Reporter: Yun Zhao
>            Priority: Minor
>         Attachments: HBASE-19226.master.001.patch
>
>
> When using MapReduce job to perform an incremental load into a table,the number of reduce tasks is the current number of regions. If there are too many regions, will lead to network+disk I/O is too large, affecting the real-time request.
> Need to use a configuration to set a number or ratio?
> Limit running reduce tasks since [https://issues.apache.org/jira/browse/MAPREDUCE-5583], the old version can only be set reduce number.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)