[jira] [Closed] (KAFKA-1075) Consumer will not rebalance upon topic partition change

["Jun Rao (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/KAFKA-1075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Jun Rao closed KAFKA-1075.
--------------------------


> Consumer will not rebalance upon topic partition change
> -------------------------------------------------------
>
>                 Key: KAFKA-1075
>                 URL: https://issues.apache.org/jira/browse/KAFKA-1075
>             Project: Kafka
>          Issue Type: Bug
>    Affects Versions: 0.8
>            Reporter: Guozhang Wang
>            Assignee: Guozhang Wang
>             Fix For: 0.8
>
>         Attachments: KAFKA-1075_2013-10-07_10:25:01.patch, KAFKA-1075_2013-10-07_10:58:40.patch, KAFKA-1075.patch
>
>
> Due to the watcher and zk data structure mismatch, consumer will not rebalance upon topic partition change. Details:
> ZK data structure for topic partitions:
> /brokers/topics/[topic-name]/partitions/[partition-id]/state
> When new partitions are added, it will change the data in /brokers/topics/[topic-name], however the ZK client is watching on child change of /brokers/topics/[topic-name], which will always be a single child 'partitions'.
> Proposal: add a data change listener, which will trigger rebalance upon data changes on /brokers/topics/[topic-name].



--
This message was sent by Atlassian JIRA
(v6.1#6144)