You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@flume.apache.org by "Hari Shreedharan (JIRA)" <ji...@apache.org> on 2015/06/18 19:54:01 UTC

[jira] [Comment Edited] (FLUME-2721) Add support for custom serializer in Kafka Sink

    [ https://issues.apache.org/jira/browse/FLUME-2721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14591250#comment-14591250 ] 

Hari Shreedharan edited comment on FLUME-2721 at 6/18/15 5:53 PM:
------------------------------------------------------------------

Kafka has its own serializers though I am not sure how that exactly works, since the type of our {{KeyedMessage}} instances are hard-coded, and they, I  believe, have to match what the serializer expects? I'd rather have those serializers take care of it than add an additional layer.


was (Author: hshreedharan):
Kafka has its own serializers though I am not sure how that exactly works, since the type of our {{KeyedMessage}}s are hard-coded, and they, I  believe, have to match what the serializer expects? I'd rather have those serializers take care of it than add an additional layer.

> Add support for custom serializer in Kafka Sink
> -----------------------------------------------
>
>                 Key: FLUME-2721
>                 URL: https://issues.apache.org/jira/browse/FLUME-2721
>             Project: Flume
>          Issue Type: Improvement
>          Components: Sinks+Sources
>    Affects Versions: v1.6.0
>            Reporter: Benjamin Fiorini
>         Attachments: FLUME-2721-0.patch
>
>
> In 1.6.0, the Kafka sink just sends the content of the body. It would be really cool to be able to have a custom serializer.
> My use case is that I'd like to send some headers as well, or better send the event serialized in JSON: {code}{"headers":{...},"body":"..."}{code}. There could be: body serializer (current behaviour) and JSON serializer.
> Will try to submit a patch soon if this makes sense.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)