You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@kafka.apache.org by "Viliam Durina (JIRA)" <ji...@apache.org> on 2017/09/18 09:01:00 UTC
[jira] [Resolved] (KAFKA-5881) Consuming from added partitions
without restarting the consumer
[ https://issues.apache.org/jira/browse/KAFKA-5881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Viliam Durina resolved KAFKA-5881.
----------------------------------
Resolution: Not A Problem
I can confirm the behaviour, after setting "metadata.max.age.ms" to zero I get fresh copy of metadata each time, including new partitions.
> Consuming from added partitions without restarting the consumer
> ---------------------------------------------------------------
>
> Key: KAFKA-5881
> URL: https://issues.apache.org/jira/browse/KAFKA-5881
> Project: Kafka
> Issue Type: Improvement
> Components: consumer
> Affects Versions: 0.11.0.0
> Reporter: Viliam Durina
>
> Currently the {{KafkaConsumer}} is not able to return events from newly added partitions, neither in automatic nor in manual assignment. I have to create a new consumer. This was a surprise to me and [other users|https://stackoverflow.com/q/46175275/952135].
> With manual assignment, the {{consumer.partitionsFor("topic")}} should eventually return new partitions.
> With automatic assignment, one of the consumers should start consuming from new partitions.
> If this is technically not possible, it should at least be documented.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)