You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@kafka.apache.org by "Guozhang Wang (Jira)" <ji...@apache.org> on 2021/10/06 18:12:00 UTC

[jira] [Created] (KAFKA-13356) Use "delete" retention policy only for stream-stream join windowed stores

Guozhang Wang created KAFKA-13356:
-------------------------------------

             Summary: Use "delete" retention policy only for stream-stream join windowed stores
                 Key: KAFKA-13356
                 URL: https://issues.apache.org/jira/browse/KAFKA-13356
             Project: Kafka
          Issue Type: Improvement
          Components: streams
            Reporter: Guozhang Wang


Today stream-stream join associated window stores, like any other window stores, use "delete,compact" as their retention policies. However, since today we add sequence number to disable de-duplication of keys, "compaction" would never be able to compact any keys, but only result in 1) CPU waste on the cleaner thread on brokers, 2) some additional feature of brokers that relies on "delete" policy to not be able to apply.

Until we change the store format potentially in the future to not use sequence number for disable de-duping, we could consider just changing the policy to "delete" for stream-stream join's window store for now.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)