[jira] [Created] (KAFKA-8179) Incremental Rebalance Protocol for Kafka Consumer

["Guozhang Wang (JIRA)" <ji...@apache.org>]

Guozhang Wang created KAFKA-8179:
------------------------------------

             Summary: Incremental Rebalance Protocol for Kafka Consumer
                 Key: KAFKA-8179
                 URL: https://issues.apache.org/jira/browse/KAFKA-8179
             Project: Kafka
          Issue Type: Improvement
          Components: consumer
            Reporter: Guozhang Wang
            Assignee: Guozhang Wang


Recently Kafka community is promoting cooperative rebalancing to mitigate the pain points in the stop-the-world rebalancing protocol. This ticket is created to initiate that idea at the Kafka consumer client, which will be beneficial for heavy-stateful consumers such as Kafka Streams applications.

In short, the scope of this ticket includes reducing unnecessary rebalance latency due to heavy partition migration: i.e. partitions being revoked and re-assigned. This would make the built-in consumer assignors (range, round-robin etc) to be aware of previously assigned partitions and be sticky in best-effort.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)