[jira] [Created] (FLUME-2874) A new interceptor called Key Interceptor should be created to insert a header with key "key" which will be used in Kakfa Sink

["Li Ye (JIRA)" <ji...@apache.org>]

Li Ye created FLUME-2874:
----------------------------

             Summary: A new interceptor called Key Interceptor should be created to insert a header with key "key" which will be used in Kakfa Sink
                 Key: FLUME-2874
                 URL: https://issues.apache.org/jira/browse/FLUME-2874
             Project: Flume
          Issue Type: New Feature
    Affects Versions: v1.6.0
            Reporter: Li Ye


Kafka Sink uses the topic and key properties from the FlumeEvent headers to send events to Kafka. If topic exists in the headers, the event will be sent to that specific topic, overriding the topic configured for the Sink. If key exists in the headers, the key will used by Kafka to partition the data between the topic partitions. Events with same key will be sent to the same partition. If the key is null, events will be sent to random partitions.
If there is a new interceptor called Key Interceptor to insert a header with key "key", much convienience will be brought to Kafka Sink users.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)