You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Tzu-Li (Gordon) Tai (JIRA)" <ji...@apache.org> on 2017/09/28 12:35:00 UTC

[jira] [Created] (FLINK-7728) StatusWatermarkValve has different min watermark advancement behavior depending on the ordering inputs become idle

Tzu-Li (Gordon) Tai created FLINK-7728:
------------------------------------------

             Summary: StatusWatermarkValve has different min watermark advancement behavior depending on the ordering inputs become idle
                 Key: FLINK-7728
                 URL: https://issues.apache.org/jira/browse/FLINK-7728
             Project: Flink
          Issue Type: Bug
          Components: DataStream API
    Affects Versions: 1.3.2, 1.2.1, 1.4.0
            Reporter: Tzu-Li (Gordon) Tai
            Assignee: Tzu-Li (Gordon) Tai
            Priority: Blocker
             Fix For: 1.2.2, 1.4.0, 1.3.3


Currently, once all inputs of a {{StatusWatermarkValve}} becomes idle, we only emit the {{StreamStatus.IDLE}} marker, and check nothing else. This makes the watermark advancement behavior inconsistent in the case that all inputs become idle, depending on the order that they become idle.

Consider the following setup:

{code}
Channel #1: Watermark 10, ACTIVE
Channel #2: Watermark 5, ACTIVE
Channel #3: Watermark 5, ACTIVE
{code}

If the channels become IDLE with the order #2 -> #3 -> #1, watermark 10 will be emitted as the new min watermark once both #2 and #3 becomes idle.
On the other hand, if the order is #1 -> #2 -> #3, watermark 10 will not be emitted.




--
This message was sent by Atlassian JIRA
(v6.4.14#64029)