You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@beam.apache.org by "Ismaël Mejía (Jira)" <ji...@apache.org> on 2020/04/13 20:06:00 UTC

[jira] [Created] (BEAM-9748) Move Reparallelize transform to Reshuffle

Ismaël Mejía created BEAM-9748:
----------------------------------

             Summary: Move Reparallelize transform to Reshuffle
                 Key: BEAM-9748
                 URL: https://issues.apache.org/jira/browse/BEAM-9748
             Project: Beam
          Issue Type: Improvement
          Components: sdk-java-core
            Reporter: Ismaël Mejía
            Assignee: Ismaël Mejía


Some DoFn based IOs like JdbcIO and RedisIO rely on the Reparallelize transform,
a combination of a an empty PCollectionView and Reshuffle to force the
materialization and reparallelize a PCollection. The idea of this issue is to
extract this transform and expose it as part of the internal Reshuffle
transform to avoid repeating the code for transforms (notably IOs) that require
to reparallelize its output.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)