You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by "Chamikara Jayalath (JIRA)" <ji...@apache.org> on 2017/08/04 18:19:00 UTC
[jira] [Created] (BEAM-2731) Add a generic Reshuffle transform to
Python SDK
Chamikara Jayalath created BEAM-2731:
----------------------------------------
Summary: Add a generic Reshuffle transform to Python SDK
Key: BEAM-2731
URL: https://issues.apache.org/jira/browse/BEAM-2731
Project: Beam
Issue Type: New Feature
Components: sdk-py
Reporter: Chamikara Jayalath
Java SDK has a Reshuffle transform [1] but Python SDK does not have this.
Following factors have to be considered when implementing this transform.
* Transform in Java has been deprecated due to intended side effects not being portable.
* A lot of details related to portability were uncovered/discussed when we tried to add a generic Redistribute transform [2][3].
[1] https://github.com/apache/beam/blob/master/sdks/java/core/src/main/java/org/apache/beam/sdk/transforms/Reshuffle.java
[2] https://github.com/apache/beam/pull/1036
[3] https://lists.apache.org/thread.html/ac34c9ac665a8d9f67b0254015e44c59ea65ecc1360d4014b95d3b2e@%3Cdev.beam.apache.org%3E
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)