You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@flink.apache.org by "Cai Liuyang (Jira)" <ji...@apache.org> on 2023/06/16 02:16:00 UTC

[jira] [Created] (FLINK-32362) SourceAlignment announceCombinedWatermark period task maybe lost

Cai Liuyang created FLINK-32362:
-----------------------------------

             Summary: SourceAlignment announceCombinedWatermark period task maybe lost
                 Key: FLINK-32362
                 URL: https://issues.apache.org/jira/browse/FLINK-32362
             Project: Flink
          Issue Type: Bug
    Affects Versions: 1.16.0
            Reporter: Cai Liuyang


When we use sourcealignment,we also found there is another problem that announceCombinedWatermark may throw a exception (like  "subtask 25 is not ready yet to receive events" , this subtask maybe under failover), which will lead the period task not running any more (ThreadPoolExecutor will not schedule the period task if it throw a exception)

I think we should increase the robustness of announceCombinedWatermark function to avoid it throw any exception (if send fail, just wait next send) (code see [https://github.com/apache/flink/blob/master/flink-runtime/src/main/java/org/apache/flink/runtime/source/coordinator/SourceCoordinator.java#L199] )



--
This message was sent by Atlassian Jira
(v8.20.10#820010)