You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@beam.apache.org by "Mark Liu (JIRA)" <ji...@apache.org> on 2016/08/31 22:52:20 UTC

[jira] [Updated] (BEAM-604) Use Watermark Check Streaming Job Finish in DataflowPipelineJob

     [ https://issues.apache.org/jira/browse/BEAM-604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Mark Liu updated BEAM-604:
--------------------------
    Summary: Use Watermark Check Streaming Job Finish in DataflowPipelineJob  (was: Use Watermark Check Streaming Job Finish in TestDataflowRunner )

> Use Watermark Check Streaming Job Finish in DataflowPipelineJob
> ---------------------------------------------------------------
>
>                 Key: BEAM-604
>                 URL: https://issues.apache.org/jira/browse/BEAM-604
>             Project: Beam
>          Issue Type: Improvement
>            Reporter: Mark Liu
>            Assignee: Mark Liu
>            Priority: Minor
>
> Currently, streaming job with bounded input can't be terminated automatically and TestDataflowRunner can't handle this case. Need to update TestDataflowRunner so that streaming integration test such as WindowedWordCountIT can run with it.
> Implementation:
> Query watermark of each step and wait until all watermarks set to MAX then cancel the job.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)