[jira] [Created] (KAFKA-7189) Add a Merge Transformer for Kafka Connect

["Abdelhamide EL ARIB (JIRA)" <ji...@apache.org>]

Abdelhamide EL ARIB created KAFKA-7189:
------------------------------------------

             Summary: Add a Merge Transformer for Kafka Connect
                 Key: KAFKA-7189
                 URL: https://issues.apache.org/jira/browse/KAFKA-7189
             Project: Kafka
          Issue Type: Improvement
          Components: KafkaConnect
            Reporter: Abdelhamide EL ARIB


Like the [flatten|[https://docs.confluent.io/current/connect/transforms/flatten.html#flatten],] there is the need too for a merge transformer.



Example transformation : 

We want to add the offset and the partition for each record, and after that merge them into one field _metadata :

 
{code:java}
"transforms":"AddOffset, AddPartition, MergeFields", 

"transforms.AddOffset.type":"org.apache.kafka.connect.transforms.InsertField$Value",
"transforms.AddOffset.offset.field":"offset!",

"transforms.AddPartition.type":"org.apache.kafka.connect.transforms.InsertField$Value",
"transforms.AddPartition.partition.field":"partition!",

"transforms.MergeFields.type":"org.apache.kafka.connect.transforms.Merge$Value",
"transforms.MergeFields.field.list":"offset,partition",
"transforms.MergeFields.field.root":"_metadata"
{code}
 


This is our MR for this transformer 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)