You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@kafka.apache.org by "Jeff Widman (JIRA)" <ji...@apache.org> on 2017/01/16 18:03:26 UTC
[jira] [Commented] (KAFKA-2410) Implement "Auto Topic Creation"
client side and remove support from Broker side
[ https://issues.apache.org/jira/browse/KAFKA-2410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15824382#comment-15824382 ]
Jeff Widman commented on KAFKA-2410:
------------------------------------
I strongly support removing it from the Broker.
But does it need to be added to the Consumer? Why not only add it to the Producer?
For the consumer, as long as it can subscribe to a non-existent topic name and then be notified once the topic is created by producing to it, there's no need to actually create a topic just by consuming from it. I think something similar to this behavior exists currently with the regex pattern subscription.
> Implement "Auto Topic Creation" client side and remove support from Broker side
> -------------------------------------------------------------------------------
>
> Key: KAFKA-2410
> URL: https://issues.apache.org/jira/browse/KAFKA-2410
> Project: Kafka
> Issue Type: Improvement
> Components: clients, core
> Affects Versions: 0.8.2.1
> Reporter: Grant Henke
> Assignee: Grant Henke
>
> Auto topic creation on the broker has caused pain in the past; And today it still causes unusual error handling requirements on the client side, added complexity in the broker, mixed responsibility of the TopicMetadataRequest, and limits configuration of the option to be cluster wide. In the future having it broker side will also make features such as authorization very difficult.
> There have been discussions in the past of implementing this feature client side. [example|https://issues.apache.org/jira/browse/KAFKA-689?focusedCommentId=13548746&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-13548746]
> This Jira is to track that discussion and implementation once the necessary protocol support exists: KAFKA-2229
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)