You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-issues@hadoop.apache.org by "Jason Lowe (JIRA)" <ji...@apache.org> on 2012/11/05 20:16:12 UTC
[jira] [Commented] (MAPREDUCE-4771) KeyFieldBasedPartitioner not
partitioning properly when configured
[ https://issues.apache.org/jira/browse/MAPREDUCE-4771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13490838#comment-13490838 ]
Jason Lowe commented on MAPREDUCE-4771:
---------------------------------------
The regression from 1.x occurs because KeyFieldBasedPartitioner implements Configurable and JobConfigurable. In 1.x it only implemented JobConfigurable, so it was only configured once.
> KeyFieldBasedPartitioner not partitioning properly when configured
> ------------------------------------------------------------------
>
> Key: MAPREDUCE-4771
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4771
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.3, 2.0.1-alpha
> Reporter: Jason Lowe
> Assignee: Jason Lowe
>
> Relative to Hadoop 0.20/1.x, KeyFieldBasedPartitioner is not distributing across partitions properly when configured. This is related to the double-configure issue as described in HADOOP-7425. KeyFieldBasedPartitioner is getting configured twice, and that ends up duplicating the keyspecs and causing the keys to be hashed twice.
> KeyFieldBasedPartitioner should not duplicate keyspecs when configured twice.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira