You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@kafka.apache.org by "Divij Vaidya (Jira)" <ji...@apache.org> on 2022/11/24 12:11:00 UTC

[jira] [Created] (KAFKA-14418) Add safety checks for modifying partitions of __consumer_offsets

Divij Vaidya created KAFKA-14418:
------------------------------------

             Summary: Add safety checks for modifying partitions of __consumer_offsets
                 Key: KAFKA-14418
                 URL: https://issues.apache.org/jira/browse/KAFKA-14418
             Project: Kafka
          Issue Type: Improvement
            Reporter: Divij Vaidya
             Fix For: 3.4.0


Today a user can change the number of partitions of {{{}__{}}}{{{}_consumer__{}}}{{{}offsets{}}} topic by changing the configuration value for {{offsets.topic.num.partitions}} or manually by using CreatePartition API. 

Changing offsets of this reserved partition leads to problems with consumer groups unless you restart all brokers.  Thus, there is a high probability that is this operations is not done right, users may shoot themselves in the foot. Example scenario: [https://stackoverflow.com/questions/73944561/kafka-consumer-group-coordinator-inconsistent] 

To remedy this, I propose the following changes:
1. `kafka-topic.sh` should explicitly block adding new partitions to internal topics
2. Add an operational guide to the docs for safely modifying partitions of __consumer_offsets at [https://kafka.apache.org/documentation.html#basic_ops] 



--
This message was sent by Atlassian Jira
(v8.20.10#820010)