You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@kafka.apache.org by "Kamal Chandraprakash (JIRA)" <ji...@apache.org> on 2018/10/05 05:34:00 UTC

[jira] [Created] (KAFKA-7483) Streams should allow headers to be passed to Serializer

Kamal Chandraprakash created KAFKA-7483:
-------------------------------------------

             Summary: Streams should allow headers to be passed to Serializer
                 Key: KAFKA-7483
                 URL: https://issues.apache.org/jira/browse/KAFKA-7483
             Project: Kafka
          Issue Type: Bug
          Components: streams
            Reporter: Kamal Chandraprakash
            Assignee: Kamal Chandraprakash


We are storing schema metadata for record key and value in the header. Serializer, includes this metadata in the record header. While doing simple record transformation (x transformed to y) in streams, the same header that was passed from source, pushed to the sink topic. This leads to error while reading the sink topic.

We should call the overloaded `serialize(topic, headers, object)` method in  org.apache.kafka.streams.processor.internals.RecordCollectorImpl#L156, #L157 which in-turn adds the correct metadata in the record header.

With this the sink topic reader have the option to read all the values for a header key using `Headers#headers`  [or] only the overwritten value using `Headers#lastHeader`



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)