You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by "Mark Liu (JIRA)" <ji...@apache.org> on 2016/08/30 03:56:20 UTC

[jira] [Created] (BEAM-604) Use Watermark Check Streaming Job Finish in TestDataflowRunner

Mark Liu created BEAM-604:
-----------------------------

             Summary: Use Watermark Check Streaming Job Finish in TestDataflowRunner 
                 Key: BEAM-604
                 URL: https://issues.apache.org/jira/browse/BEAM-604
             Project: Beam
          Issue Type: Bug
            Reporter: Mark Liu
            Assignee: Mark Liu


Currently, streaming job with bounded input can't be terminated automatically and TestDataflowRunner can't handle this case. Need to update TestDataflowRunner so that streaming integration test such as WindowedWordCountIT can run with it.

Implementation:
Query watermark of each step and wait until all watermarks set to MAX then cancel the job.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)