You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@kafka.apache.org by "Matthias (JIRA)" <ji...@apache.org> on 2017/11/27 17:11:00 UTC

[jira] [Created] (KAFKA-6273) Allow names for windowing joins

Matthias created KAFKA-6273:
-------------------------------

             Summary: Allow names for windowing joins
                 Key: KAFKA-6273
                 URL: https://issues.apache.org/jira/browse/KAFKA-6273
             Project: Kafka
          Issue Type: Improvement
            Reporter: Matthias


Currently, the internal name of a windowing join is generated at runtime using a counter to ensure uniqueness within a running topology. 

If a topology is changed and redeployed, different names can be generated for the same window. This can result in lost windowing state without intervention modifying offsets to re-consume the input topics.

https://kafka.apache.org/10/javadoc/org/apache/kafka/streams/kstream/Joined.html

The proposed change would be to add an optional configuration parameter "joinName" to Joined. If provided, this would be used by KStreamImpl to generate internal names when building a join. If not provided the existing name generation would be used. (Since this is an opt-in, optional parameter there would be no impact on existing code.)




--
This message was sent by Atlassian JIRA
(v6.4.14#64029)