You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@kafka.apache.org by "Viliam Durina (JIRA)" <ji...@apache.org> on 2017/09/18 09:01:00 UTC

[jira] [Resolved] (KAFKA-5881) Consuming from added partitions without restarting the consumer

     [ https://issues.apache.org/jira/browse/KAFKA-5881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Viliam Durina resolved KAFKA-5881.
----------------------------------
    Resolution: Not A Problem

I can confirm the behaviour, after setting "metadata.max.age.ms" to zero I get fresh copy of metadata each time, including new partitions.

> Consuming from added partitions without restarting the consumer
> ---------------------------------------------------------------
>
>                 Key: KAFKA-5881
>                 URL: https://issues.apache.org/jira/browse/KAFKA-5881
>             Project: Kafka
>          Issue Type: Improvement
>          Components: consumer
>    Affects Versions: 0.11.0.0
>            Reporter: Viliam Durina
>
> Currently the {{KafkaConsumer}} is not able to return events from newly added partitions, neither in automatic nor in manual assignment. I have to create a new consumer. This was a surprise to me and [other users|https://stackoverflow.com/q/46175275/952135].
> With manual assignment, the {{consumer.partitionsFor("topic")}} should eventually return new partitions.
> With automatic assignment, one of the consumers should start consuming from new partitions.
> If this is technically not possible, it should at least be documented.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)