You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@flume.apache.org by "Hari Shreedharan (JIRA)" <ji...@apache.org> on 2015/10/09 02:32:28 UTC

[jira] [Commented] (FLUME-2781) A Kafka Channel defined as parseAsFlumeEvent=false cannot be correctly used by a Flume source

    [ https://issues.apache.org/jira/browse/FLUME-2781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14949671#comment-14949671 ] 

Hari Shreedharan commented on FLUME-2781:
-----------------------------------------

+1. LGTM. I am running the tests now. Will commit once the tests pass.

> A Kafka Channel defined as parseAsFlumeEvent=false cannot be correctly used by a Flume source
> ---------------------------------------------------------------------------------------------
>
>                 Key: FLUME-2781
>                 URL: https://issues.apache.org/jira/browse/FLUME-2781
>             Project: Flume
>          Issue Type: Improvement
>    Affects Versions: v1.6.0
>            Reporter: Gonzalo Herreros
>              Labels: easyfix, patch
>         Attachments: FLUME-2781.patch
>
>
> When a Kafka channel is configured as parseAsFlumeEvent=false, the channel will read events from the topic as text instead of serialized Avro Flume events.
> This is useful so Flume can read from an existing Kafka topic, where other Kafka clients publish as text.
> However, if you use a Flume source on that channel, it will still write the events as Avro so it will create an inconsistency and those events will fail to be read correctly.
> Also, this would allow a Flume source to write to a Kafka channel and any Kafka subscriber to listen to Flume events passing through without binary dependencies.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)