You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@kafka.apache.org by "Lukas Welte (JIRA)" <ji...@apache.org> on 2019/05/23 07:22:00 UTC

[jira] [Created] (KAFKA-8411) Option to keep tombstones forever in compacted logs

Lukas Welte created KAFKA-8411:
----------------------------------

             Summary: Option to keep tombstones forever in compacted logs 
                 Key: KAFKA-8411
                 URL: https://issues.apache.org/jira/browse/KAFKA-8411
             Project: Kafka
          Issue Type: Improvement
          Components: log cleaner
            Reporter: Lukas Welte


Log compaction is great to balance between having all data in a topic and reducing the amount of messages in a topic.

However the delete tombstones are cleaned after a certain period. For some use cases we would really like to keep the latest message of each key, which means also the tombstone of that ID should be kept forever.

An option to configure _delete.retention.ms_ to e.g. _-1_ to enable this functionality would be great.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)