cluster reboot and leader selection

["Yu, Libo " <li...@citi.com>]

Hi,

We have three hosts (1, 2, 3) in a kafka cluster. When we restart the cluster,
If broker on host 2 restarts first, then most of partitions will use broker 2
as leader. Ideally, we want to see one third topics use broker 1 as leader,
other one third topics use broker 2 and the remaining one third use broker 3.
So how to evenly distribute the leaders among the 3 brokers in this case?

Thanks.

Libo

Re: cluster reboot and leader selection

[Joel Koshy <jj...@gmail.com>]

Good point - it was brought up some time ago, and there is a jira to
track that feature: https://issues.apache.org/jira/browse/KAFKA-930

On Wed, Aug 14, 2013 at 8:35 AM, Yu, Libo <li...@citi.com> wrote:
> It seems this tool needs to be run from time to time.
> When a broker is restarted, the tool must be run to
> balance the load. My question is why this balancing
> is not built into the broker. So it will automatically run
> after a broker restarts and that will make operation
> easier.
>
> Regards,
>
> Libo
>
>
> -----Original Message-----
> From: Joel Koshy [mailto:jjkoshy.w@gmail.com]
> Sent: Tuesday, August 13, 2013 5:50 PM
> To: users@kafka.apache.org
> Subject: Re: cluster reboot and leader selection
>
> You can run the preferred replica leader election tool after the restarts (https://cwiki.apache.org/confluence/display/KAFKA/Replication+tools)

RE: cluster reboot and leader selection

["Yu, Libo " <li...@citi.com>]

It seems this tool needs to be run from time to time.
When a broker is restarted, the tool must be run to 
balance the load. My question is why this balancing 
is not built into the broker. So it will automatically run
after a broker restarts and that will make operation
easier.

Regards,

Libo


-----Original Message-----
From: Joel Koshy [mailto:jjkoshy.w@gmail.com] 
Sent: Tuesday, August 13, 2013 5:50 PM
To: users@kafka.apache.org
Subject: Re: cluster reboot and leader selection

You can run the preferred replica leader election tool after the restarts (https://cwiki.apache.org/confluence/display/KAFKA/Replication+tools)

Re: cluster reboot and leader selection

[Joel Koshy <jj...@gmail.com>]

You can run the preferred replica leader election tool after the
restarts (https://cwiki.apache.org/confluence/display/KAFKA/Replication+tools)