[jira] [Resolved] (KAFKA-13356) Use "delete" retention policy only for stream-stream join windowed stores

["Matthias J. Sax (Jira)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/KAFKA-13356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Matthias J. Sax resolved KAFKA-13356.
-------------------------------------
    Resolution: Duplicate

> Use "delete" retention policy only for stream-stream join windowed stores
> -------------------------------------------------------------------------
>
>                 Key: KAFKA-13356
>                 URL: https://issues.apache.org/jira/browse/KAFKA-13356
>             Project: Kafka
>          Issue Type: Improvement
>          Components: streams
>            Reporter: Guozhang Wang
>            Assignee: Matthias J. Sax
>            Priority: Major
>
> Today stream-stream join associated window stores, like any other window stores, use "delete,compact" as their retention policies. However, since today we add sequence number to disable de-duplication of keys, "compaction" would never be able to compact any keys, but only result in 1) CPU waste on the cleaner thread on brokers, 2) some additional feature of brokers that relies on "delete" policy to not be able to apply.
> Until we change the store format potentially in the future to not use sequence number for disable de-duping, we could consider just changing the policy to "delete" for stream-stream join's window store for now.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)