You are viewing a plain text version of this content. The canonical link for it is here.

Posted to users@kafka.apache.org by Vito Sabella <vs...@msn.com> on 2012/09/13 17:59:13 UTC

Lots of topics in Kafka

Are there any good solutions to scaling with lots of small topics in Kafka?  I'm talking about say 100,000 unique, but low-volume topics with dozens of subscribers mixed in with say 100 high volume topics?

 

Thanks

Vito

Re: Lots of topics in Kafka

Posted by Jun Rao <ju...@gmail.com>.

In 0.7, each topic exists on every broker. So it's not scalable. In 0.8, a
topic only exists on a small number of brokers (replication factor). To
support more topics, you can just add more brokers.

Thanks,

Jun

On Thu, Sep 13, 2012 at 8:59 AM, Vito Sabella <vs...@msn.com> wrote:

> Are there any good solutions to scaling with lots of small topics in
> Kafka?  I'm talking about say 100,000 unique, but low-volume topics with
> dozens of subscribers mixed in with say 100 high volume topics?
>
>
>
> Thanks
>
> Vito