You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@beam.apache.org by GitBox <gi...@apache.org> on 2022/06/03 17:29:17 UTC
[GitHub] [beam] kennknowles opened a new issue, #18357: DataflowRunner drops Reads with no consumers
kennknowles opened a new issue, #18357:
URL: https://github.com/apache/beam/issues/18357
Basically, if a pipeline has "just" a Read with no consumers, the optimizer in Dataflow will drop it. To preserve Beam semantics, we do want to run the Read and drop its output, e.g., because the Read may have side effects that we're testing for.
Is it possible with pipeline surgery to find such Reads and add an Identity ParDo to them?
Imported from Jira [BEAM-2007](https://issues.apache.org/jira/browse/BEAM-2007). Original Jira may contain additional context.
Reported by: dhalperi.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [beam] kennknowles commented on issue #18357: DataflowRunner drops Reads with no consumers
Posted by GitBox <gi...@apache.org>.
kennknowles commented on issue #18357:
URL: https://github.com/apache/beam/issues/18357#issuecomment-1372815919
completed before migration to GitHub Issues
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [beam] kennknowles closed issue #18357: DataflowRunner drops Reads with no consumers
Posted by GitBox <gi...@apache.org>.
kennknowles closed issue #18357: DataflowRunner drops Reads with no consumers
URL: https://github.com/apache/beam/issues/18357
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org