[jira] [Created] (KAFKA-8554) Generate Topic/Key from Json Transform

["Gokhan Sari (JIRA)" <ji...@apache.org>]

Gokhan Sari created KAFKA-8554:
----------------------------------

             Summary: Generate Topic/Key from Json Transform
                 Key: KAFKA-8554
                 URL: https://issues.apache.org/jira/browse/KAFKA-8554
             Project: Kafka
          Issue Type: New Feature
          Components: KafkaConnect
            Reporter: Gokhan Sari


In a configurable pattern, topic and key generation is needed. This pattern could include static values and dynamic parameters which are exist in json tree.

Eg:
 * property.format = "*signals_\{appId}_\{date}" >> "signals_app01_18-06-2019"*
 ** static '*signals*' *sdf*
 ** parameter '*appId*' from json tree
 ** parameter or record '*date*'

 * property.date.field = "*details.signalCreationDate"*
 ** parameter '*details.signalCreationDate*' path from json tree

 * property.date.format = "*dd-MM-yyyy"*
 ** date format for date parameters or record dates

 

Extracting topic or key (properties) with these way will led developers to use them according to their business logic.

 

Especially this will be useful for Elasticsearch Kafka Connector in case of dynamic index name and dynamic document id generation needs.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)