You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@beam.apache.org by GitBox <gi...@apache.org> on 2022/06/30 22:30:47 UTC
[GitHub] [beam] steveniemitz opened a new issue, #22120: [Bug]: Pipelines with unbounded PCollections but without `--streaming` incorrectly print a warning message on Dataflow
steveniemitz opened a new issue, #22120:
URL: https://github.com/apache/beam/issues/22120
### What happened?
#16773 seems to have caused spurious warnings for pipelines with unbounded PCollections but that don't set `--streaming`. Previously they would correctly be inferred to run in streaming mode in Dataflow, after this change they still are, however a very ominous warning is logged:
```
WARNING: Unbounded PCollection(s) found in a batch pipeline! You might consider using 'streaming=true'! Unbounded PCollection(s): <a very large amount of text>
```
### Issue Priority
Priority: 2
### Issue Component
Component: runner-dataflow
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [beam] github-actions[bot] closed issue #22120: [Bug]: Pipelines with unbounded PCollections but without `--streaming` incorrectly print a warning message on Dataflow
Posted by GitBox <gi...@apache.org>.
github-actions[bot] closed issue #22120: [Bug]: Pipelines with unbounded PCollections but without `--streaming` incorrectly print a warning message on Dataflow
URL: https://github.com/apache/beam/issues/22120
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [beam] kennknowles commented on issue #22120: [Bug]: Pipelines with unbounded PCollections but without `--streaming` incorrectly print a warning message on Dataflow
Posted by GitBox <gi...@apache.org>.
kennknowles commented on issue #22120:
URL: https://github.com/apache/beam/issues/22120#issuecomment-1335863231
Yea this warning should not happen. I don't know why it is here. I guess because the nature of streaming execution and the costs may be unexpected?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org