You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@beam.apache.org by "Kenneth Knowles (JIRA)" <ji...@apache.org> on 2019/01/16 01:23:00 UTC
[jira] [Updated] (BEAM-2902) Add user state support for ParDo.Multi
for the Dataflow runner
[ https://issues.apache.org/jira/browse/BEAM-2902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Kenneth Knowles updated BEAM-2902:
----------------------------------
Fix Version/s: 2.11.0
> Add user state support for ParDo.Multi for the Dataflow runner
> --------------------------------------------------------------
>
> Key: BEAM-2902
> URL: https://issues.apache.org/jira/browse/BEAM-2902
> Project: Beam
> Issue Type: Sub-task
> Components: runner-dataflow
> Reporter: Luke Cwik
> Priority: Minor
> Labels: portability, sickbay
> Fix For: 2.11.0
>
>
> Add support for user state in a ParDo.Multi by:
> * adding expansion/conversion logic within Dataflow service to add any needed GBKs to allow expansion.
> *OR*
> * Add support for expansion inside the Beam SDK once the PTransformMatcher exposes a way to know when the replacement is not required by checking that the preceding ParDos to a GBK are key preserving.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)