You are viewing a plain text version of this content. The canonical link for it is here.

Posted to jira@kafka.apache.org by "Bruno Cadonna (Jira)" <ji...@apache.org> on 2020/06/10 14:50:00 UTC

[jira] [Created] (KAFKA-10137) Clean-up retain Duplicate logic in Window Stores

Bruno Cadonna created KAFKA-10137:
-------------------------------------

             Summary: Clean-up retain Duplicate logic in Window Stores
                 Key: KAFKA-10137
                 URL: https://issues.apache.org/jira/browse/KAFKA-10137
             Project: Kafka
          Issue Type: Task
          Components: streams
    Affects Versions: 2.5.0
            Reporter: Bruno Cadonna


Stream-stream joins use the regular `WindowStore` implementation but with `retainDuplicates` set to true. To allow for duplicates while using the same unique-key underlying stores we just wrap the key with an incrementing sequence number before inserting it.

The logic to maintain and append the sequence number is present in multiple locations, namely in the changelogging window store and in its underlying window stores. We should consolidate this code to one single location.  



--
This message was sent by Atlassian Jira
(v8.3.4#803005)