You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@flink.apache.org by Marke Builder <ma...@gmail.com> on 2019/03/07 17:03:49 UTC

Consume only a few of kafka topic partitions

Hi,

it is possible that my flume-kafka consumer read only from part of all
Kafka patitions? What I mean is that I can use kafka to route certain
messages into specific partitions. And with my flink job I would only
consume this partitions (not all topic partitions).

Thanks!

Marke

Re:Consume only a few of kafka topic partitions

Posted by shengjk1 <js...@163.com>.

Hi, Marke


I understand that you want to consume only the specified partition of a topic of kafka. if so, current  flink (1.7.x/1.8.x) is not support, you can  see


https://issues.apache.org/jira/browse/FLINK-11257 




Best,
Shengjk1




On 03/8/2019 01:03，Marke Builder<ma...@gmail.com> wrote：
Hi,


it is possible that my flume-kafka consumer read only from part of all Kafka patitions? What I mean is that I can use kafka to route certain messages into specific partitions. And with my flink job I would only consume this partitions (not all topic partitions).


Thanks!


Marke