You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@kafka.apache.org by "Kumar, Vaibhav " <va...@citi.com> on 2013/08/14 15:22:42 UTC
All Lead Replica are on a Single Broker
Kafka Dev,
I am not sure if we are missing something over here but after cluster restart I see all the existing topics choose one broker as the Lead replica which is probably not a right behavior as we want to distribute the load across the cluster
opic: credit.cache.smc.debt.queue partition: 0 leader: 2 replicas: 1,3,2 isr: 2,1,3
topic: credit.cache.smc.debt.queue partition: 1 leader: 2 replicas: 2,1,3 isr: 2,1,3
topic: credit.cache.smc.debt.queue partition: 2 leader: 2 replicas: 3,2,1 isr: 2,1,3
topic: credit.cache.smc.debt.topic partition: 0 leader: 2 replicas: 2,3,1 isr: 2,1,3
topic: credit.cache.smc.debt.topic partition: 1 leader: 2 replicas: 3,1,2 isr: 2,1,3
topic: credit.cache.smc.debt.topic partition: 2 leader: 2 replicas: 1,2,3 isr: 2,1,3
topic: credit.cache.smc.equity.queue partition: 0 leader: 2 replicas: 2,1,3 isr: 2,1,3
topic: credit.cache.smc.equity.queue partition: 1 leader: 2 replicas: 3,2,1 isr: 2,1,3
topic: credit.cache.smc.equity.queue partition: 2 leader: 2 replicas: 1,3,2 isr: 2,1,3
topic: credit.cache.smc.equity.topic partition: 0 leader: 2 replicas: 3,2,1 isr: 2,1,3
topic: credit.cache.smc.equity.topic partition: 1 leader: 2 replicas: 1,3,2 isr: 2,1,3
topic: credit.cache.smc.equity.topic partition: 2 leader: 2 replicas: 2,1,3 isr: 2,1,3
topic: credit.cache.smc.govt.queue partition: 0 leader: 2 replicas: 3,2,1 isr: 2,1,3
topic: credit.cache.smc.govt.queue partition: 1 leader: 2 replicas: 1,3,2 isr: 2,1,3
topic: credit.cache.smc.govt.queue partition: 2 leader: 2 replicas: 2,1,3 isr: 2,1,3
topic: credit.cache.smc.govt.topic partition: 0 leader: 2 replicas: 1,3,2 isr: 2,1,3
topic: credit.cache.smc.govt.topic partition: 1 leader: 2 replicas: 2,1,3 isr: 2,1,3
topic: credit.cache.smc.govt.topic partition: 2 leader: 2 replicas: 3,2,1 isr: 2,1,3
Regards,
Vaibhav
Re: All Lead Replica are on a Single Broker
Posted by Jun Rao <ju...@gmail.com>.
I think Joel answered a similar question in the user mailing list.
You can run the preferred replica leader election tool after the
restarts (
https://cwiki.apache.org/confluence/display/KAFKA/Replication+tools)
Thanks,
Jun
On Wed, Aug 14, 2013 at 6:22 AM, Kumar, Vaibhav <va...@citi.com>wrote:
> Kafka Dev,
>
> I am not sure if we are missing something over here but after cluster
> restart I see all the existing topics choose one broker as the Lead replica
> which is probably not a right behavior as we want to distribute the load
> across the cluster
>
> opic: credit.cache.smc.debt.queue partition: 0 leader: 2
> replicas: 1,3,2 isr: 2,1,3
> topic: credit.cache.smc.debt.queue partition: 1 leader: 2
> replicas: 2,1,3 isr: 2,1,3
> topic: credit.cache.smc.debt.queue partition: 2 leader: 2
> replicas: 3,2,1 isr: 2,1,3
> topic: credit.cache.smc.debt.topic partition: 0 leader: 2
> replicas: 2,3,1 isr: 2,1,3
> topic: credit.cache.smc.debt.topic partition: 1 leader: 2
> replicas: 3,1,2 isr: 2,1,3
> topic: credit.cache.smc.debt.topic partition: 2 leader: 2
> replicas: 1,2,3 isr: 2,1,3
> topic: credit.cache.smc.equity.queue partition: 0 leader: 2
> replicas: 2,1,3 isr: 2,1,3
> topic: credit.cache.smc.equity.queue partition: 1 leader: 2
> replicas: 3,2,1 isr: 2,1,3
> topic: credit.cache.smc.equity.queue partition: 2 leader: 2
> replicas: 1,3,2 isr: 2,1,3
> topic: credit.cache.smc.equity.topic partition: 0 leader: 2
> replicas: 3,2,1 isr: 2,1,3
> topic: credit.cache.smc.equity.topic partition: 1 leader: 2
> replicas: 1,3,2 isr: 2,1,3
> topic: credit.cache.smc.equity.topic partition: 2 leader: 2
> replicas: 2,1,3 isr: 2,1,3
> topic: credit.cache.smc.govt.queue partition: 0 leader: 2
> replicas: 3,2,1 isr: 2,1,3
> topic: credit.cache.smc.govt.queue partition: 1 leader: 2
> replicas: 1,3,2 isr: 2,1,3
> topic: credit.cache.smc.govt.queue partition: 2 leader: 2
> replicas: 2,1,3 isr: 2,1,3
> topic: credit.cache.smc.govt.topic partition: 0 leader: 2
> replicas: 1,3,2 isr: 2,1,3
> topic: credit.cache.smc.govt.topic partition: 1 leader: 2
> replicas: 2,1,3 isr: 2,1,3
> topic: credit.cache.smc.govt.topic partition: 2 leader: 2
> replicas: 3,2,1 isr: 2,1,3
>
> Regards,
> Vaibhav
>