You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@flink.apache.org by "Till Rohrmann (JIRA)" <ji...@apache.org> on 2014/11/12 18:18:33 UTC

[jira] [Created] (FLINK-1237) Add custom partitioners for shuffle steps

Till Rohrmann created FLINK-1237:
------------------------------------

             Summary: Add custom partitioners for shuffle steps
                 Key: FLINK-1237
                 URL: https://issues.apache.org/jira/browse/FLINK-1237
             Project: Flink
          Issue Type: Improvement
            Reporter: Till Rohrmann
            Assignee: Stephan Ewen


It would be helpful to be able to specify a custom partitioner for shuffle steps. This would users allow to control how their data is distributed across the cluster. Especially in situations where the number of data records is equal to the number of slots it might be a possibility to avoid skewed data distributions due to the default hashing function.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)