You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@flink.apache.org by "Stephan Ewen (JIRA)" <ji...@apache.org> on 2014/11/18 12:24:33 UTC

[jira] [Resolved] (FLINK-1237) Add custom partitioners for shuffle steps

     [ https://issues.apache.org/jira/browse/FLINK-1237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Stephan Ewen resolved FLINK-1237.
---------------------------------
       Resolution: Implemented
    Fix Version/s: 0.8-incubating

Implemented via 2000b45ce3e71ed6eddecbb3f8658ebecec58230

> Add custom partitioners for shuffle steps
> -----------------------------------------
>
>                 Key: FLINK-1237
>                 URL: https://issues.apache.org/jira/browse/FLINK-1237
>             Project: Flink
>          Issue Type: Improvement
>            Reporter: Till Rohrmann
>            Assignee: Stephan Ewen
>             Fix For: 0.8-incubating
>
>
> It would be helpful to be able to specify a custom partitioner for shuffle steps. This would users allow to control how their data is distributed across the cluster. Especially in situations where the number of data records is equal to the number of slots it might be a possibility to avoid skewed data distributions due to the default hashing function.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)