[jira] [Created] (KAFKA-19735) Add automatic commit offset caching in subscribe mode

["kangning.li (Jira)" <ji...@apache.org>]

kangning.li created KAFKA-19735:
-----------------------------------

             Summary: Add automatic commit offset caching in subscribe mode
                 Key: KAFKA-19735
                 URL: https://issues.apache.org/jira/browse/KAFKA-19735
             Project: Kafka
          Issue Type: Improvement
            Reporter: kangning.li
            Assignee: kangning.li


Suppose that no new messages have been written to the target topic for a long time, for example, the producer has not generated new data for nearly an hour. On the consumer side, when the user sets enable.auto.commit=true, the OFFSET_COMMIT request will still be repeatedly submitted every 5 seconds. This not only wastes network resources but also increases the burden on __consumer_offset.

 
Therefore, maybe we can add a cache for committed offsets to check if the currently committed offset is consistent with the most recently successfully committed offset. If they are the same, this offset commit can be ignored. Of course, all the above applies to the subscribe mode.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)