[jira] [Commented] (KAFKA-2275) Add a ListTopics() API to the new consumer

["Joel Koshy (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/KAFKA-2275?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14625095#comment-14625095 ] 

Joel Koshy commented on KAFKA-2275:
-----------------------------------

[~onurkaraman] has also been doing some thinking on this - there is _some_ overlap (not entirely) with the producer and admin tools and were considering refactoring some of this sort of functionality into an admin client layer. It may make sense for you guys to sync-up either on this jira or offline (and follow-up on this jira afterward).

> Add a ListTopics() API to the new consumer
> ------------------------------------------
>
>                 Key: KAFKA-2275
>                 URL: https://issues.apache.org/jira/browse/KAFKA-2275
>             Project: Kafka
>          Issue Type: Sub-task
>          Components: consumer
>            Reporter: Guozhang Wang
>            Assignee: Ashish K Singh
>            Priority: Critical
>             Fix For: 0.8.3
>
>
> With regex subscription like
> {code}
> consumer.subscribe("topic*")
> {code}
> The partition assignment is automatically done at the Kafka side, while there are some use cases where consumers want regex subscriptions but not Kafka-side partition assignment, rather with their own specific partition assignment. With ListTopics() they can periodically check for topic list changes and specifically subscribe to the partitions of the new topics.
> For implementation, it involves sending a TopicMetadataRequest to a random broker and parse the response.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)