You are viewing a plain text version of this content. The canonical link for it is here.

Posted to jira@kafka.apache.org by "Jordan Moore (Jira)" <ji...@apache.org> on 2020/04/08 04:56:00 UTC

[jira] [Commented] (KAFKA-9782) Kafka Connect InsertField transform - Add the ability to insert event's Key into Value

    [ https://issues.apache.org/jira/browse/KAFKA-9782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17077833#comment-17077833 ] 

Jordan Moore commented on KAFKA-9782:
-------------------------------------

This already exists as an external SMT

https://github.com/jcustenborder/kafka-connect-transform-archive

> Kafka Connect InsertField transform - Add the ability to insert event's Key into Value
> --------------------------------------------------------------------------------------
>
>                 Key: KAFKA-9782
>                 URL: https://issues.apache.org/jira/browse/KAFKA-9782
>             Project: Kafka
>          Issue Type: Improvement
>          Components: KafkaConnect
>            Reporter: Ryan Tomczik
>            Priority: Major
>
> I'm using Debezium to pull change data capture events from a Mongo DB and write them to S3 with the Confluent S3 Sink. The problem is Debezium stores the document's key in each event's key and the S3 connector discards this key. I need the ability to insert the key as a new field in the event value. It seems that this would fit in perfectly into the InsertField transform or create a new transform KeyToValue.
> Here is an example of someone else running into this same limitation and creating a custom transform.
> [https://gist.github.com/shashidesai/aaf72489165c6a0fd73a3b51e5a8892a]
>  



--
This message was sent by Atlassian Jira
(v8.3.4#803005)