You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@kafka.apache.org by "Matthias J. Sax (Jira)" <ji...@apache.org> on 2019/11/25 00:47:00 UTC
[jira] [Updated] (KAFKA-7578) Kafka streams: add possibility to
choose multiple output topics
[ https://issues.apache.org/jira/browse/KAFKA-7578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Matthias J. Sax updated KAFKA-7578:
-----------------------------------
Description:
KIP draft: [https://cwiki.apache.org/confluence/display/KAFKA/KIP-422%3A+%5BStreams%5D+Support+multiple+topic+resolution+in+TopicNameExtractor]
There is an awesome feature which was added in 2.0 kafka stream - possibility to choose dynamically the output topic for topology, but in some cases it could be useful to chose several topics withing the same cluster.
Personally me - I met such case: I needed to route message based on its content and by routes configuration to several topics.
I've made a 'proposal' PR for this, unfortunately I couldn't find better way to implement this:
[https://github.com/apache/kafka/pull/5801]
If this approach is OK, and improvement could be done in future versions, please let me know and I'll finish PR code.
was:
There is an awesome feature which was added in 2.0 kafka stream - possibility to choose dynamically the output topic for topology, but in some cases it could be useful to chose several topics withing the same cluster.
Personally me - I met such case: I needed to route message based on its content and by routes configuration to several topics.
I've made a 'proposal' PR for this, unfortunately I couldn't find better way to implement this:
[https://github.com/apache/kafka/pull/5801]
If this approach is OK, and improvement could be done in future versions, please let me know and I'll finish PR code.
> Kafka streams: add possibility to choose multiple output topics
> ----------------------------------------------------------------
>
> Key: KAFKA-7578
> URL: https://issues.apache.org/jira/browse/KAFKA-7578
> Project: Kafka
> Issue Type: New Feature
> Components: streams
> Reporter: Taras Danylchuk
> Priority: Minor
> Labels: needs-kip, user-experience
>
> KIP draft: [https://cwiki.apache.org/confluence/display/KAFKA/KIP-422%3A+%5BStreams%5D+Support+multiple+topic+resolution+in+TopicNameExtractor]
> There is an awesome feature which was added in 2.0 kafka stream - possibility to choose dynamically the output topic for topology, but in some cases it could be useful to chose several topics withing the same cluster.
> Personally me - I met such case: I needed to route message based on its content and by routes configuration to several topics.
> I've made a 'proposal' PR for this, unfortunately I couldn't find better way to implement this:
> [https://github.com/apache/kafka/pull/5801]
> If this approach is OK, and improvement could be done in future versions, please let me know and I'll finish PR code.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)