You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@kafka.apache.org by "Divij Vaidya (Jira)" <ji...@apache.org> on 2022/11/24 12:11:00 UTC
[jira] [Created] (KAFKA-14418) Add safety checks for modifying partitions of __consumer_offsets
Divij Vaidya created KAFKA-14418:
------------------------------------
Summary: Add safety checks for modifying partitions of __consumer_offsets
Key: KAFKA-14418
URL: https://issues.apache.org/jira/browse/KAFKA-14418
Project: Kafka
Issue Type: Improvement
Reporter: Divij Vaidya
Fix For: 3.4.0
Today a user can change the number of partitions of {{{}__{}}}{{{}_consumer__{}}}{{{}offsets{}}} topic by changing the configuration value for {{offsets.topic.num.partitions}} or manually by using CreatePartition API.
Changing offsets of this reserved partition leads to problems with consumer groups unless you restart all brokers. Thus, there is a high probability that is this operations is not done right, users may shoot themselves in the foot. Example scenario: [https://stackoverflow.com/questions/73944561/kafka-consumer-group-coordinator-inconsistent]
To remedy this, I propose the following changes:
1. `kafka-topic.sh` should explicitly block adding new partitions to internal topics
2. Add an operational guide to the docs for safely modifying partitions of __consumer_offsets at [https://kafka.apache.org/documentation.html#basic_ops]
--
This message was sent by Atlassian Jira
(v8.20.10#820010)