You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Jark Wu (Jira)" <ji...@apache.org> on 2020/07/08 11:53:00 UTC

[jira] [Updated] (FLINK-18523) Advance watermark if there is no data in all of the partitions after some time

     [ https://issues.apache.org/jira/browse/FLINK-18523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Jark Wu updated FLINK-18523:
----------------------------
    Summary: Advance watermark if there is no data in all of the partitions after some time  (was: The watermark could be updated without data for some time)

> Advance watermark if there is no data in all of the partitions after some time
> ------------------------------------------------------------------------------
>
>                 Key: FLINK-18523
>                 URL: https://issues.apache.org/jira/browse/FLINK-18523
>             Project: Flink
>          Issue Type: New Feature
>    Affects Versions: 1.11.0
>            Reporter: chen yong
>            Priority: Major
>
> In the case of window calculations and eventTime scenarios, watermar cannot update because the source does not have data for some reason, and the last Windows cannot trigger the calculations.
> One parameter, table.exec.source. Idle -timeout, can only solve the problem of ignoring parallelism of watermark alignment that does not occur.But when there is no watermark in each parallel degree, you still cannot update the watermark.
> Is it possible to add a lock-timeout parameter (which should be larger than maxOutOfOrderness with default of "-1 ms") and if the watermark is not updated beyond this time (i.e., there is no data), then the current time is taken and sent downstream as the watermark.
>  
> thanks!



--
This message was sent by Atlassian Jira
(v8.3.4#803005)