You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@kafka.apache.org by "Guozhang Wang (JIRA)" <ji...@apache.org> on 2018/05/20 05:02:00 UTC

[jira] [Created] (KAFKA-6922) Rethink WindowedStreamPartitioner configurations

Guozhang Wang created KAFKA-6922:
------------------------------------

             Summary: Rethink WindowedStreamPartitioner configurations
                 Key: KAFKA-6922
                 URL: https://issues.apache.org/jira/browse/KAFKA-6922
             Project: Kafka
          Issue Type: Improvement
          Components: streams
            Reporter: Guozhang Wang


For windowed KStream / KTable in Streams DSL, the library will use a WindowedStreamPartitioner dynamically at runtime. But this configuration is relying on runtime type inference which is not efficient. Another issue is that for dynamic routing on sink node, the topic name would not be known before hand so the partitioner need to call a different {{partition}} function that requires a topic name as parameter.

We can consider if there is a better way to configure the windowed stream partitioner when making windowed KStream / KTable as its own secondary class in the DSL.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)