You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@flume.apache.org by "Li Ye (JIRA)" <ji...@apache.org> on 2016/03/25 04:46:25 UTC

[jira] [Resolved] (FLUME-2874) A new interceptor called Key Interceptor should be created to insert a header with key "key" which will be used in Kakfa Sink

     [ https://issues.apache.org/jira/browse/FLUME-2874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Li Ye resolved FLUME-2874.
--------------------------
    Resolution: Not A Problem

> A new interceptor called Key Interceptor should be created to insert a header with key "key" which will be used in Kakfa Sink
> -----------------------------------------------------------------------------------------------------------------------------
>
>                 Key: FLUME-2874
>                 URL: https://issues.apache.org/jira/browse/FLUME-2874
>             Project: Flume
>          Issue Type: New Feature
>    Affects Versions: v1.6.0
>            Reporter: Li Ye
>   Original Estimate: 168h
>  Remaining Estimate: 168h
>
> Kafka Sink uses the topic and key properties from the FlumeEvent headers to send events to Kafka. If topic exists in the headers, the event will be sent to that specific topic, overriding the topic configured for the Sink. If key exists in the headers, the key will used by Kafka to partition the data between the topic partitions. Events with same key will be sent to the same partition. If the key is null, events will be sent to random partitions.
> If there is a new interceptor called Key Interceptor to insert a header with key "key", much convienience will be brought to Kafka Sink users.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)