You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@flink.apache.org by "Timo Walther (Jira)" <ji...@apache.org> on 2021/05/21 14:52:00 UTC

[jira] [Created] (FLINK-22748) Allow dynamic target topic selection in Kafka sinks

Timo Walther created FLINK-22748:
------------------------------------

             Summary: Allow dynamic target topic selection in Kafka sinks
                 Key: FLINK-22748
                 URL: https://issues.apache.org/jira/browse/FLINK-22748
             Project: Flink
          Issue Type: Improvement
          Components: Table SQL / Ecosystem
            Reporter: Timo Walther


We should allow to write to different Kafka topics based on some column value in SQL.

The existing implementation can be easily adapted for that. The "target topic" would be an additional persisted metadata column in SQL terms. All one need to do is to adapt

DynamicKafkaSerializationSchema

KafkaDynamicSink

We should guard this dynamic behavior via a config option and make the topic option optional in this case.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)