[jira] [Created] (KAFKA-19895) __consumer_offsets Partitions Growing to TB Size and Not Cleaning Until Broker Restart

["zhangtongr (Jira)" <ji...@apache.org>]

zhangtongr created KAFKA-19895:
----------------------------------

             Summary: __consumer_offsets Partitions Growing to TB Size and Not Cleaning Until Broker Restart
                 Key: KAFKA-19895
                 URL: https://issues.apache.org/jira/browse/KAFKA-19895
             Project: Kafka
          Issue Type: Bug
          Components: log cleaner
    Affects Versions: 2.7.1
            Reporter: zhangtongr


Description:
We encountered an abnormal situation with the Kafka system topic `__consumer_offsets` where 
two specific partition replicas grew to extremely large sizes and did not respond to cleanup policies.

Details:

1. Two replicas under `__consumer_offsets` unexpectedly reached extremely large sizes:
   - Partition replica size: **8.4 TB**
   - Partition replica size: **3.9 TB**
   Other replicas of the same topic are only about **100 MB**, which is normal.

2. We attempted to force cleanup by applying:



--
This message was sent by Atlassian Jira
(v8.20.10#820010)