You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@beam.apache.org by GitBox <gi...@apache.org> on 2022/06/03 15:06:39 UTC
[GitHub] [beam] damccorm opened a new issue, #17846: DataflowPipelineJob should have an API that prints messages but doesn't wait for completion
damccorm opened a new issue, #17846:
URL: https://github.com/apache/beam/issues/17846
DataflowPipelineJob has a method waitToFinish() that takes a handler for printing the job's output messages, AND waits for the job to finish, printing messages along the way using that handler.
However, there are cases when a caller would like to poll for the job's messages and print them, but would like to keep the job under the caller's control, rather than having to wait for it to complete.
E.g., one can imagine wanting to do the following "wait until a certain Aggregator in the job reaches a certain value, and then cancel the job, printing messages along the way". This is not possible with the current API, without copying code of waitToFinish().
Imported from Jira [BEAM-89](https://issues.apache.org/jira/browse/BEAM-89). Original Jira may contain additional context.
Reported by: jkff.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [beam] damccorm closed issue #17846: DataflowPipelineJob should have an API that prints messages but doesn't wait for completion
Posted by GitBox <gi...@apache.org>.
damccorm closed issue #17846: DataflowPipelineJob should have an API that prints messages but doesn't wait for completion
URL: https://github.com/apache/beam/issues/17846
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org