You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@beam.apache.org by "Beam JIRA Bot (Jira)" <ji...@apache.org> on 2020/09/02 17:08:38 UTC

[jira] [Commented] (BEAM-2007) DataflowRunner drops Reads with no consumers

    [ https://issues.apache.org/jira/browse/BEAM-2007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17189501#comment-17189501 ] 

Beam JIRA Bot commented on BEAM-2007:
-------------------------------------

This issue was marked "stale-P2" and has not received a public comment in 14 days. It is now automatically moved to P3. If you are still affected by it, you can comment and move it back to P2.

> DataflowRunner drops Reads with no consumers
> --------------------------------------------
>
>                 Key: BEAM-2007
>                 URL: https://issues.apache.org/jira/browse/BEAM-2007
>             Project: Beam
>          Issue Type: Bug
>          Components: runner-dataflow, sdk-py-core
>            Reporter: Dan Halperin
>            Priority: P3
>
> Basically, if a pipeline has "just" a Read with no consumers, the optimizer in Dataflow will drop it. To preserve Beam semantics, we do want to run the Read and drop its output, e.g., because the Read may have side effects that we're testing for.
> Is it possible with pipeline surgery to find such Reads and add an Identity ParDo to them?



--
This message was sent by Atlassian Jira
(v8.3.4#803005)