[jira] [Created] (FLINK-27396) Reduce the Heartbeat timeout after zookeeper suspended

["fanrui (Jira)" <ji...@apache.org>]

fanrui created FLINK-27396:
------------------------------

             Summary: Reduce the Heartbeat timeout after zookeeper suspended
                 Key: FLINK-27396
                 URL: https://issues.apache.org/jira/browse/FLINK-27396
             Project: Flink
          Issue Type: Improvement
          Components: Runtime / Coordination
    Affects Versions: 1.14.0, 1.15.0
            Reporter: fanrui
             Fix For: 1.16.0


After FLINK-10052, flink will tolerate zk suspension if `high-availability.zookeeper.client.tolerate-suspended-connections` is enabled. This feature is very useful, it reduces unnecessary Flink job failover in case of zk server crashing some nodes or zk rolling restart.

Two cases result in zk SUSPENDED:
 * The zk server to which the TM/JM is connected is stopped
 * TM has a network partition.

For the first case, we hope Flink can tolerate it. For the second case, we want the TM to fail fast, because the JM may have started a new TM, and if this TM does not fail, it may deal with duplicate data (network partitioning is complicated). But in the second case, TM will still run until zk lost(high-availability.zookeeper.client.session-timeout, default 60s) or heartbeat timeout with JM (heartbeat.timeout, default 50s).

Can we set heartbeat.timeout to 20s if zk is suspended? If zk is suspended and the heartbeat times out, execute zk lost related logic.



--
This message was sent by Atlassian Jira
(v8.20.7#820007)