You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hbase.apache.org by "Rishit Shroff (JIRA)" <ji...@apache.org> on 2013/11/05 20:34:17 UTC

[jira] [Created] (HBASE-9896) Add an option to have strict number of mapper per job in HBase Streaming

Rishit Shroff created HBASE-9896:
------------------------------------

             Summary: Add an option to have strict number of mapper per job in HBase Streaming
                 Key: HBASE-9896
                 URL: https://issues.apache.org/jira/browse/HBASE-9896
             Project: HBase
          Issue Type: New Feature
          Components: mapreduce
    Affects Versions: 0.89-fb
            Reporter: Rishit Shroff
            Assignee: Rishit Shroff
            Priority: Minor
             Fix For: 0.89-fb


Currently there is only one configuration knob available for controlling the number of mappers per job in HBase Streaming. The current option is number of mappers per region. This options tries to maintain the locality for the mapper and the region servers.

However, in certain certain scenarios where the table has a higher number of regions, the number of mapper/region can lead to explosion of the number of mappers. Hence, we need one more option to control the strict number of mappers per job.



--
This message was sent by Atlassian JIRA
(v6.1#6144)