You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@beam.apache.org by "Beam JIRA Bot (Jira)" <ji...@apache.org> on 2020/09/04 17:07:01 UTC

[jira] [Updated] (BEAM-10110) Populate pipeline_proto_coder_id field for dataflow.

     [ https://issues.apache.org/jira/browse/BEAM-10110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Beam JIRA Bot updated BEAM-10110:
---------------------------------
    Labels: stale-P2  (was: )

> Populate pipeline_proto_coder_id field for dataflow.
> ----------------------------------------------------
>
>                 Key: BEAM-10110
>                 URL: https://issues.apache.org/jira/browse/BEAM-10110
>             Project: Beam
>          Issue Type: Task
>          Components: runner-dataflow, sdk-go
>            Reporter: Robert Burke
>            Priority: P2
>              Labels: stale-P2
>          Time Spent: 1h 10m
>  Remaining Estimate: 0h
>
> Dataflow isn't natively translating from the Beam Pipeline Proto yet, but requires SDKs to translate the graph into it's own format. Adding this hint for custom coders (Coders  not known to Dataflow/Beam) avoids having dataflow re-synthesize coders from it's format, back to the pipeline proto.
> Currently there's the awkward restriction on which coders should receive the ID, rather than having the SDK apply the field to all of them, but this is a good first step to get there. This restriction may be lifted on a subsequent dataflow release. 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)