[jira] [Created] (KAFKA-15911) KRaft quorum leader should make sure the follower fetch is making progress

["Luke Chen (Jira)" <ji...@apache.org>]

Luke Chen created KAFKA-15911:
---------------------------------

             Summary: KRaft quorum leader should make sure the follower fetch is making progress
                 Key: KAFKA-15911
                 URL: https://issues.apache.org/jira/browse/KAFKA-15911
             Project: Kafka
          Issue Type: Bug
          Components: kraft
            Reporter: Luke Chen


Just because the leader returned a successful response to FETCH and FETCH_SNAPSHOT doesn't mean that the followers were able to handle the response correctly.

For example, imagine the case where the log end offset (LEO) is at 1000 and all of the followers are continuously fetching at offset 0 without ever increasing their fetch offset. This can happen if the followers encounter an error when processing the FETCH or FETCH_SNAPSHOT response.

In this scenario the leader will never be able to increase the HWM. I think that this scenario is specific to KRaft and doesn't exists in Raft because KRaft is pull vs Raft which is push.


https://github.com/apache/kafka/pull/14428#pullrequestreview-1751408695



--
This message was sent by Atlassian Jira
(v8.20.10#820010)