You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by "Ahmet Altay (JIRA)" <ji...@apache.org> on 2017/08/09 01:43:00 UTC

[jira] [Resolved] (BEAM-2731) Add a generic Reshuffle transform to Python SDK

     [ https://issues.apache.org/jira/browse/BEAM-2731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Ahmet Altay resolved BEAM-2731.
-------------------------------
       Resolution: Duplicate
    Fix Version/s: Not applicable

Duplicate of https://issues.apache.org/jira/browse/BEAM-1872

> Add a generic Reshuffle transform to Python SDK
> -----------------------------------------------
>
>                 Key: BEAM-2731
>                 URL: https://issues.apache.org/jira/browse/BEAM-2731
>             Project: Beam
>          Issue Type: New Feature
>          Components: sdk-py
>            Reporter: Chamikara Jayalath
>             Fix For: Not applicable
>
>
> Java SDK has a Reshuffle transform [1] but Python SDK does not have this.
> Following factors have to be considered when implementing this transform.
> * Transform in Java has been deprecated due to intended side effects not being portable.
> * A lot of details related to portability were uncovered/discussed when we tried to add a generic Redistribute transform [2][3].
> [1] https://github.com/apache/beam/blob/master/sdks/java/core/src/main/java/org/apache/beam/sdk/transforms/Reshuffle.java
> [2] https://github.com/apache/beam/pull/1036
> [3] https://lists.apache.org/thread.html/ac34c9ac665a8d9f67b0254015e44c59ea65ecc1360d4014b95d3b2e@%3Cdev.beam.apache.org%3E



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)