[jira] [Created] (KAFKA-13345) WindowStore should use "delete" policy when duplicates are enabled

["Matthias J. Sax (Jira)" <ji...@apache.org>]

Matthias J. Sax created KAFKA-13345:
---------------------------------------

             Summary: WindowStore should use "delete" policy when duplicates are enabled
                 Key: KAFKA-13345
                 URL: https://issues.apache.org/jira/browse/KAFKA-13345
             Project: Kafka
          Issue Type: Improvement
          Components: streams
            Reporter: Matthias J. Sax


For stream-stream join, windowed stores are configures to retain duplicates. For this case, each key written into the store is unique.

At the same time, windowed store changelog topics are configured with cleanup policy "delete,compact" by default. However, with retained duplicates, and thus effectively unique keys, log compaction does not make sense.

To avoid keeping the broker log compaction thread busy without doing actual useful work for those topics, we should change the topic config to "delete" if duplicates are retained.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)