You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@kafka.apache.org by "Guozhang Wang (JIRA)" <ji...@apache.org> on 2018/05/20 05:02:00 UTC
[jira] [Created] (KAFKA-6922) Rethink WindowedStreamPartitioner
configurations
Guozhang Wang created KAFKA-6922:
------------------------------------
Summary: Rethink WindowedStreamPartitioner configurations
Key: KAFKA-6922
URL: https://issues.apache.org/jira/browse/KAFKA-6922
Project: Kafka
Issue Type: Improvement
Components: streams
Reporter: Guozhang Wang
For windowed KStream / KTable in Streams DSL, the library will use a WindowedStreamPartitioner dynamically at runtime. But this configuration is relying on runtime type inference which is not efficient. Another issue is that for dynamic routing on sink node, the topic name would not be known before hand so the partitioner need to call a different {{partition}} function that requires a topic name as parameter.
We can consider if there is a better way to configure the windowed stream partitioner when making windowed KStream / KTable as its own secondary class in the DSL.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)