You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@flume.apache.org by "Viktor Gerdin (JIRA)" <ji...@apache.org> on 2017/04/05 20:03:41 UTC

[jira] [Updated] (FLUME-3081) KafkaSource outputs offset in header

     [ https://issues.apache.org/jira/browse/FLUME-3081?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Viktor Gerdin updated FLUME-3081:
---------------------------------
    Attachment: FLUME-3081-0.patch

> KafkaSource outputs offset in header
> ------------------------------------
>
>                 Key: FLUME-3081
>                 URL: https://issues.apache.org/jira/browse/FLUME-3081
>             Project: Flume
>          Issue Type: Improvement
>    Affects Versions: 1.7.0, 1.8.0
>            Reporter: Viktor Gerdin
>            Priority: Minor
>         Attachments: FLUME-3081-0.patch
>
>
> In FLUME-2799 the original request included (amongst others) Kafka offset to be part of the message headers from the KafkaSource. However the ticket was resolved without it. In affected versions the possible headers are:
> * topic
> * partition
> * key
> * timestamp (agent JVM system time)
> I propose to add offset in order to make a traceable system key (topic+partition+offset) in order to synchronise between several consumers (something necessary for my case). 



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)