You are viewing a plain text version of this content. The canonical link for it is here.

Posted to users@kafka.apache.org by John Heslop <jo...@gmail.com> on 2019/11/04 18:05:23 UTC

Re: Records with null value (tombstone) are not removed during compaction


On 2019/10/10 16:06:39, Uma Maheswari <um...@gmail.com> wrote: 
> I have created a topic with cleanup.policy set to compact. segment.ms and delete.retention.ms are also configured for the topic. Compaction is happening but records with null value are not removed. But when segment.bytes is configured, records with null value are removed. Please help.
> 
> Thanks,
> Uma
> 

These links might give some useful background:

https://issues.apache.org/jira/browse/KAFKA-7321
ensure timely processing of deletion requests in Kafka topic (Time-based log compaction)

https://issues.apache.org/jira/browse/KAFKA-7137
ability to trigger compaction for tombstoning and GDPR

Regards,
John