[jira] [Created] (KAFKA-7423) Kafka compact topic data missing.

["Hanlin Liu (JIRA)" <ji...@apache.org>]

Hanlin Liu created KAFKA-7423:
---------------------------------

             Summary: Kafka compact topic data missing.
                 Key: KAFKA-7423
                 URL: https://issues.apache.org/jira/browse/KAFKA-7423
             Project: Kafka
          Issue Type: Bug
          Components: core
    Affects Versions: 0.10.2.0
            Reporter: Hanlin Liu


We are using a single node kafka and schema registry with version 0.10.2.
We are experiencing data lost for _schemas topic which is a compact topic used by schema registry for storage.
 
There are only 4 messages in the topic and we can see a lot of (50+) subjects from schema registry rest service \{schema registry}:8081/subjects.
The topic is configured to compact cleanup policy:
Topic:_schemas PartitionCount:1 ReplicationFactor:1 Configs:cleanup.policy=compact
Topic: _schemas Partition: 0 Leader: 1001 Replicas: 1001 Isr: 1001
 
The broker retention hours is set to 120 hours and the first message in the topic was written 3 days ago.
 
We can see the data from the schema registry rest service, we believe schema registry didn't delete the data.
So we are suspecting kafka broker retentioned the data for some reason. 
 
 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)