Custom metadata in message header

[Lesong Jia <le...@gmail.com>]

Hey all,

I am new to Kafka. Is there a way to provide a custom metadata in the
message header?

Thanks,
Lesong

Re: Custom metadata in message header

[Lance Laursen <ll...@rubiconproject.com>]

Hey Lesong,

Unfortunately not. Any metadata you would like to include must be placed in
the message payload. This means you must consume each message and process
it in order to determine whether it is relevant to your current task.

You can achieve some data locality by using keyed messages and an
associated partitioner.class (ie: semantic partitioning). This will result
in messages with a common key ending up on the same partition, thereby
reducing the workload of your consumer.

On Tue, Nov 17, 2015 at 12:55 PM, Lesong Jia <le...@gmail.com> wrote:

> Hey all,
>
> I am new to Kafka. Is there a way to provide a custom metadata in the
> message header?
>
> Thanks,
> Lesong
>