You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@beam.apache.org by "Thomas Weise (Jira)" <ji...@apache.org> on 2020/08/19 15:59:00 UTC

[jira] [Updated] (BEAM-838) Support parallelism in Apex runner

     [ https://issues.apache.org/jira/browse/BEAM-838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Thomas Weise updated BEAM-838:
------------------------------
    Fix Version/s:     (was: 2.23.0)

> Support parallelism in Apex runner
> ----------------------------------
>
>                 Key: BEAM-838
>                 URL: https://issues.apache.org/jira/browse/BEAM-838
>             Project: Beam
>          Issue Type: Improvement
>          Components: runner-apex
>            Reporter: Thomas Weise
>            Priority: P2
>              Labels: beam-fixit, stale-P2
>
> The Apex runner should leverage the partitioning features of Apex for Beam pipeline translation (parallel partitions, dynamic partitioning and cascading unifiers etc.). Specifically for ParDo and GroupByKey (GBK partitioning will also need the appropriate stream codec that will partition the stream based on the encoded key).  Enabling the partitioning will also require watermarks to be broadcasted on a separate Apex operator port.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)