You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hbase.apache.org by "Amitanand Aiyer (JIRA)" <ji...@apache.org> on 2012/06/27 00:47:44 UTC

[jira] [Created] (HBASE-6278) Allow table splits during a MapReduce job to be parameterized the same way as we parameterize the splitAlgorithm during table creation.

Amitanand Aiyer created HBASE-6278:
--------------------------------------

             Summary: Allow table splits during a MapReduce job to be parameterized the same way as we parameterize the splitAlgorithm during table creation.
                 Key: HBASE-6278
                 URL: https://issues.apache.org/jira/browse/HBASE-6278
             Project: HBase
          Issue Type: Improvement
    Affects Versions: 0.89-fb
            Reporter: Amitanand Aiyer
            Assignee: Amitanand Aiyer
            Priority: Minor


Current implementation uses Uniform Splits, which can be different from the one used to create the table (if created using HexSplit).

Using different split algorithms results in input splits that are skewed. Allow the MR job to accept a split Algorithm to enable even splitting into map tasks.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Resolved] (HBASE-6278) Allow table splits during a MapReduce job to be parameterized the same way as we parameterize the splitAlgorithm during table creation.

Posted by "Amitanand Aiyer (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HBASE-6278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Amitanand Aiyer resolved HBASE-6278.
------------------------------------

    Resolution: Fixed
    
> Allow table splits during a MapReduce job to be parameterized the same way as we parameterize the splitAlgorithm during table creation.
> ---------------------------------------------------------------------------------------------------------------------------------------
>
>                 Key: HBASE-6278
>                 URL: https://issues.apache.org/jira/browse/HBASE-6278
>             Project: HBase
>          Issue Type: Improvement
>    Affects Versions: 0.89-fb
>            Reporter: Amitanand Aiyer
>            Assignee: Amitanand Aiyer
>            Priority: Minor
>
> Current implementation uses Uniform Splits, which can be different from the one used to create the table (if created using HexSplit).
> Using different split algorithms results in input splits that are skewed. Allow the MR job to accept a split Algorithm to enable even splitting into map tasks.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira