Zookeeper to Broker Count

["Jason J. W. Williams" <ja...@gmail.com>]

Hi Guys,

In general, is it a good idea to run a ZK node on each Kafka broker? In
otherwords, as you add broker nodes you are also adding ZK nodes 1:1. Or
should the ZK cluster be kept a smaller fixed size (like 3)?

Thank you in advance.

-J

Re: Zookeeper to Broker Count

["Jason J. W. Williams" <ja...@gmail.com>]

Thanks Ewen!

-J

On Tue, Jan 26, 2016 at 1:44 PM, Ewen Cheslack-Postava <ew...@confluent.io>
wrote:

> No, you don't need to keep adding ZK nodes. You should have a 3 or 5 node
> ZK cluster. The more nodes you use, the slower write performance becomes,
> so adding more can hurt performance of any ZK-related operations. The
> tradeoff between 3 and 5 ZK nodes is fault tolerance (better with 5) vs
> write performance (better with 3).
>
> -Ewen
>
> On Tue, Jan 26, 2016 at 12:09 PM, Jason J. W. Williams <
> jasonjwwilliams@gmail.com> wrote:
>
> > Hi Guys,
> >
> > In general, is it a good idea to run a ZK node on each Kafka broker? In
> > otherwords, as you add broker nodes you are also adding ZK nodes 1:1. Or
> > should the ZK cluster be kept a smaller fixed size (like 3)?
> >
> > Thank you in advance.
> >
> > -J
> >
>
>
>
> --
> Thanks,
> Ewen
>

Re: Zookeeper to Broker Count

[Ewen Cheslack-Postava <ew...@confluent.io>]

No, you don't need to keep adding ZK nodes. You should have a 3 or 5 node
ZK cluster. The more nodes you use, the slower write performance becomes,
so adding more can hurt performance of any ZK-related operations. The
tradeoff between 3 and 5 ZK nodes is fault tolerance (better with 5) vs
write performance (better with 3).

-Ewen

On Tue, Jan 26, 2016 at 12:09 PM, Jason J. W. Williams <
jasonjwwilliams@gmail.com> wrote:

> Hi Guys,
>
> In general, is it a good idea to run a ZK node on each Kafka broker? In
> otherwords, as you add broker nodes you are also adding ZK nodes 1:1. Or
> should the ZK cluster be kept a smaller fixed size (like 3)?
>
> Thank you in advance.
>
> -J
>



-- 
Thanks,
Ewen