[jira] [Commented] (BEAM-2007) DataflowRunner drops Reads with no consumers

["Beam JIRA Bot (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/BEAM-2007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17179897#comment-17179897 ] 

Beam JIRA Bot commented on BEAM-2007:
-------------------------------------

This issue is P2 but has been unassigned without any comment for 60 days so it has been labeled "stale-P2". If this issue is still affecting you, we care! Please comment and remove the label. Otherwise, in 14 days the issue will be moved to P3.

Please see https://beam.apache.org/contribute/jira-priorities/ for a detailed explanation of what these priorities mean.


> DataflowRunner drops Reads with no consumers
> --------------------------------------------
>
>                 Key: BEAM-2007
>                 URL: https://issues.apache.org/jira/browse/BEAM-2007
>             Project: Beam
>          Issue Type: Bug
>          Components: runner-dataflow, sdk-py-core
>            Reporter: Dan Halperin
>            Priority: P2
>              Labels: stale-P2
>
> Basically, if a pipeline has "just" a Read with no consumers, the optimizer in Dataflow will drop it. To preserve Beam semantics, we do want to run the Read and drop its output, e.g., because the Read may have side effects that we're testing for.
> Is it possible with pipeline surgery to find such Reads and add an Identity ParDo to them?



--
This message was sent by Atlassian Jira
(v8.3.4#803005)