You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@flume.apache.org by "Sebastian Alfers (JIRA)" <ji...@apache.org> on 2017/01/02 14:45:58 UTC

[jira] [Commented] (FLUME-2942) AvroEventDeserializer ignores header from spool source

    [ https://issues.apache.org/jira/browse/FLUME-2942?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15792976#comment-15792976 ] 

Sebastian Alfers commented on FLUME-2942:
-----------------------------------------

[~lakshman] Thank you for participation. I update my pull request. What do you think?

> AvroEventDeserializer ignores header from spool source
> ------------------------------------------------------
>
>                 Key: FLUME-2942
>                 URL: https://issues.apache.org/jira/browse/FLUME-2942
>             Project: Flume
>          Issue Type: Bug
>    Affects Versions: v1.6.0
>            Reporter: Sebastian Alfers
>         Attachments: FLUME-2942-0.patch
>
>
> I have a spool file source and use avro for de-/serialization
> In detail, serialized events store the topic of the kafka sink in the header.
> When I load the events from the spool directory, the header are ignored. 
> Please see: https://github.com/apache/flume/blob/caa64a1a6d4bc97be5993cb468516e9ffe862794/flume-ng-core/src/main/java/org/apache/flume/serialization/AvroEventDeserializer.java#L122
> You can see, it uses the whole event as body but does not distinguish between the header and body encoded by avro.
> Please verify that this is a bug.
> I fixed this but by using the record that stores header and body separately.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)