You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@flink.apache.org by Janardhan Reddy <ja...@olacabs.com> on 2016/08/08 17:16:02 UTC

Kafka producer connector

Hi,
The Flink kafka producer uses fixed partitioner by default and all our
events are ending up in 1-2 partitions. Is there any inbuilt partitioner
which distributes keys such that same key maps to same partition.

Thanks

Re: Kafka producer connector

Posted by Robert Metzger <rm...@apache.org>.

Hi Janardhan,

the fixed partitioner is the only one shipped with Flink.
However, it should be fairly simple to implement one that uses the key to
determine the partition.

On Mon, Aug 8, 2016 at 7:16 PM, Janardhan Reddy <janardhan.reddy@olacabs.com
> wrote:

> Hi,
> The Flink kafka producer uses fixed partitioner by default and all our
> events are ending up in 1-2 partitions. Is there any inbuilt partitioner
> which distributes keys such that same key maps to same partition.
>
> Thanks
>