You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by "Chamikara Jayalath (JIRA)" <ji...@apache.org> on 2017/08/04 18:19:00 UTC

[jira] [Created] (BEAM-2731) Add a generic Reshuffle transform to Python SDK

Chamikara Jayalath created BEAM-2731:
----------------------------------------

             Summary: Add a generic Reshuffle transform to Python SDK
                 Key: BEAM-2731
                 URL: https://issues.apache.org/jira/browse/BEAM-2731
             Project: Beam
          Issue Type: New Feature
          Components: sdk-py
            Reporter: Chamikara Jayalath


Java SDK has a Reshuffle transform [1] but Python SDK does not have this.

Following factors have to be considered when implementing this transform.

* Transform in Java has been deprecated due to intended side effects not being portable.
* A lot of details related to portability were uncovered/discussed when we tried to add a generic Redistribute transform [2][3].

[1] https://github.com/apache/beam/blob/master/sdks/java/core/src/main/java/org/apache/beam/sdk/transforms/Reshuffle.java
[2] https://github.com/apache/beam/pull/1036
[3] https://lists.apache.org/thread.html/ac34c9ac665a8d9f67b0254015e44c59ea65ecc1360d4014b95d3b2e@%3Cdev.beam.apache.org%3E



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)