[jira] [Resolved] (BEAM-9733) ImpulseSourceFunction does not emit a final watermark

["Kyle Weaver (Jira)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/BEAM-9733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Kyle Weaver resolved BEAM-9733.
-------------------------------
    Resolution: Fixed

> ImpulseSourceFunction does not emit a final watermark
> -----------------------------------------------------
>
>                 Key: BEAM-9733
>                 URL: https://issues.apache.org/jira/browse/BEAM-9733
>             Project: Beam
>          Issue Type: Bug
>          Components: runner-flink
>            Reporter: Maximilian Michels
>            Assignee: Maximilian Michels
>            Priority: Critical
>             Fix For: 2.21.0
>
>          Time Spent: 10h 50m
>  Remaining Estimate: 0h
>
> The Flink Runner's {{ImpulseSourceFunction}} does not emit a final watermark, unless {{--shutdownSourcesOnFinalWatermark}} flag has been specified (the flag is used in tests to shutdown the pipeline after reading all data). Most pipelines will be long-running and thus do not specify the flag. 
> Not sending out the final watermark causes GroupByKey to hold back the data of event time windows until the pipeline is shut down (the final watermark is always emitted on pipeline shutdown which is why using the above flag works).



--
This message was sent by Atlassian Jira
(v8.3.4#803005)