You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@kafka.apache.org by Kane Kane <ka...@gmail.com> on 2013/10/16 00:46:22 UTC
partition reassignment
I have 3 brokers and a topic with replication factor of 3.
Somehow all partitions ended up being on the same broker.
I've created topic with 3 brokers alive, and they didn't die since then.
Even when i try to reassign it:
bin/kafka-reassign-partitions.sh --zookeeper
10.80.42.147:2181--broker-list 0,1,2 --topics-to-move-json-file
~/reassign.txt --execute
The leader of all partitions after that is still the single broker (first
one).
This is how my json file looks like:
{"topics":
[{"topic": "perf1"}],
"version":1
}
The command reports success:
Successfully started reassignment of partitions Map([perf1,33] -> List(1,
0, 2), [perf1,13] -> List(2, 0, 1), [perf1,28] -> List(2, 1, 0), [perf1,20]
-> List(0, 1, 2), [perf1,5] -> List(0, 2, 1), [perf1,14] -> List(0, 1, 2),
[perf1,39] -> List(1, 0, 2), [perf1,19] -> List(2, 0, 1), [perf1,25] ->
List(2, 0, 1), [perf1,43] -> List(2, 0, 1), [perf1,11] -> List(0, 2, 1),
[perf1,8] -> List(0, 1, 2), [perf1,22] -> List(2, 1, 0), [perf1,16] ->
List(2, 1, 0), [perf1,26] -> List(0, 1, 2), [perf1,41] -> List(0, 2, 1),
[perf1,9] -> List(1, 0, 2), [perf1,27] -> List(1, 0, 2), [perf1,44] ->
List(0, 1, 2), [perf1,34] -> List(2, 1, 0), [perf1,6] -> List(1, 2, 0),
[perf1,1] -> List(2, 0, 1), [perf1,37] -> List(2, 0, 1), [perf1,24] ->
List(1, 2, 0), [perf1,29] -> List(0, 2, 1), [perf1,32] -> List(0, 1, 2),
[perf1,7] -> List(2, 0, 1), [perf1,17] -> List(0, 2, 1), [perf1,36] ->
List(1, 2, 0), [perf1,0] -> List(1, 2, 0), [perf1,42] -> List(1, 2, 0),
[perf1,4] -> List(2, 1, 0), [perf1,10] -> List(2, 1, 0), [perf1,30] ->
List(1, 2, 0), [perf1,23] -> List(0, 2, 1), [perf1,18] -> List(1, 2, 0),
[perf1,3] -> List(1, 0, 2), [perf1,35] -> List(0, 2, 1), [perf1,31] ->
List(2, 0, 1), [perf1,12] -> List(1, 2, 0), [perf1,2] -> List(0, 1, 2),
[perf1,40] -> List(2, 1, 0), [perf1,38] -> List(0, 1, 2), [perf1,15] ->
List(1, 0, 2), [perf1,21] -> List(1, 0, 2))
But still nothing changes. I use ~/kafka-src/bin/kafka-topics.sh
--zookeeper 10.80.42.147:2181 --describe --topic perf1 to check leaders.
Thanks.
Re: partition reassignment
Posted by Kane Kane <ka...@gmail.com>.
Thanks for advise!
On Wed, Oct 16, 2013 at 7:57 AM, Jun Rao <ju...@gmail.com> wrote:
> Make sure that there is no under replicated partitions (use the
> --under-replicated option in the list topic command) before you run that
> tool.
>
> Thanks,
>
> Jun
>
>
> On Wed, Oct 16, 2013 at 12:29 AM, Kane Kane <ka...@gmail.com> wrote:
>
> > Yes, thanks, looks like that's what i need, do you know why it tends to
> > choose the leader for all partitions on the single broker, despite I have
> > 3?
> >
> >
> > On Wed, Oct 16, 2013 at 12:19 AM, Joel Koshy <jj...@gmail.com>
> wrote:
> >
> > > Did the reassignment complete? If the assigned replicas are in ISR and
> > > the preferred replicas for the partitions are evenly distributed
> > > across the brokers (which seems to be a case on a cursory glance of
> > > your assignment) you can use this tool:
> > >
> > >
> >
> https://cwiki.apache.org/confluence/display/KAFKA/Replication+tools#Replicationtools-2.PreferredReplicaLeaderElectionTool
> > >
> > > On Wed, Oct 16, 2013 at 12:15 AM, Kane Kane <ka...@gmail.com>
> > wrote:
> > > > Oh i see, what is the better way to initiate the leader change? As I
> > told
> > > > somehow all my partitions have the same leader for some reason. I
> have
> > 3
> > > > brokers and all partitions have leader on single one.
> > > >
> > > >
> > > > On Wed, Oct 16, 2013 at 12:04 AM, Joel Koshy <jj...@gmail.com>
> > > wrote:
> > > >
> > > >> For a leader change yes, but this is partition reassignment which
> > > >> completes when all the reassigned replicas are in sync with the
> > > >> original replica(s). You can check the status of the command using
> the
> > > >> option I mentioned earlier.
> > > >>
> > > >> On Tue, Oct 15, 2013 at 7:02 PM, Kane Kane <ka...@gmail.com>
> > > wrote:
> > > >> > I thought if i have all replicas in sync, leader change should be
> > much
> > > >> > faster?
> > > >> >
> > > >> >
> > > >> > On Tue, Oct 15, 2013 at 5:12 PM, Joel Koshy <jj...@gmail.com>
> > > wrote:
> > > >> >
> > > >> >> Depending on how much data there is in those partitions it can
> > take a
> > > >> >> while for reassignment to actually complete. You will need to use
> > the
> > > >> >> --status-check-json-file option of the reassign partitions
> command
> > to
> > > >> >> determine whether partition reassignment has completed or not.
> > > >> >>
> > > >> >> Joel
> > > >> >>
> > > >> >>
> > > >> >> On Tue, Oct 15, 2013 at 3:46 PM, Kane Kane <
> kane.isturm@gmail.com>
> > > >> wrote:
> > > >> >> > I have 3 brokers and a topic with replication factor of 3.
> > > >> >> > Somehow all partitions ended up being on the same broker.
> > > >> >> > I've created topic with 3 brokers alive, and they didn't die
> > since
> > > >> then.
> > > >> >> >
> > > >> >> > Even when i try to reassign it:
> > > >> >> > bin/kafka-reassign-partitions.sh --zookeeper
> > > >> >> > 10.80.42.147:2181--broker-list 0,1,2
> --topics-to-move-json-file
> > > >> >> > ~/reassign.txt --execute
> > > >> >> >
> > > >> >> > The leader of all partitions after that is still the single
> > broker
> > > >> (first
> > > >> >> > one).
> > > >> >> > This is how my json file looks like:
> > > >> >> > {"topics":
> > > >> >> > [{"topic":
> "perf1"}],
> > > >> >> > "version":1
> > > >> >> > }
> > > >> >> >
> > > >> >> > The command reports success:
> > > >> >> > Successfully started reassignment of partitions Map([perf1,33]
> ->
> > > >> List(1,
> > > >> >> > 0, 2), [perf1,13] -> List(2, 0, 1), [perf1,28] -> List(2, 1,
> 0),
> > > >> >> [perf1,20]
> > > >> >> > -> List(0, 1, 2), [perf1,5] -> List(0, 2, 1), [perf1,14] ->
> > > List(0, 1,
> > > >> >> 2),
> > > >> >> > [perf1,39] -> List(1, 0, 2), [perf1,19] -> List(2, 0, 1),
> > > [perf1,25]
> > > >> ->
> > > >> >> > List(2, 0, 1), [perf1,43] -> List(2, 0, 1), [perf1,11] ->
> List(0,
> > > 2,
> > > >> 1),
> > > >> >> > [perf1,8] -> List(0, 1, 2), [perf1,22] -> List(2, 1, 0),
> > > [perf1,16] ->
> > > >> >> > List(2, 1, 0), [perf1,26] -> List(0, 1, 2), [perf1,41] ->
> List(0,
> > > 2,
> > > >> 1),
> > > >> >> > [perf1,9] -> List(1, 0, 2), [perf1,27] -> List(1, 0, 2),
> > > [perf1,44] ->
> > > >> >> > List(0, 1, 2), [perf1,34] -> List(2, 1, 0), [perf1,6] ->
> List(1,
> > 2,
> > > >> 0),
> > > >> >> > [perf1,1] -> List(2, 0, 1), [perf1,37] -> List(2, 0, 1),
> > > [perf1,24] ->
> > > >> >> > List(1, 2, 0), [perf1,29] -> List(0, 2, 1), [perf1,32] ->
> List(0,
> > > 1,
> > > >> 2),
> > > >> >> > [perf1,7] -> List(2, 0, 1), [perf1,17] -> List(0, 2, 1),
> > > [perf1,36] ->
> > > >> >> > List(1, 2, 0), [perf1,0] -> List(1, 2, 0), [perf1,42] ->
> List(1,
> > 2,
> > > >> 0),
> > > >> >> > [perf1,4] -> List(2, 1, 0), [perf1,10] -> List(2, 1, 0),
> > > [perf1,30] ->
> > > >> >> > List(1, 2, 0), [perf1,23] -> List(0, 2, 1), [perf1,18] ->
> List(1,
> > > 2,
> > > >> 0),
> > > >> >> > [perf1,3] -> List(1, 0, 2), [perf1,35] -> List(0, 2, 1),
> > > [perf1,31] ->
> > > >> >> > List(2, 0, 1), [perf1,12] -> List(1, 2, 0), [perf1,2] ->
> List(0,
> > 1,
> > > >> 2),
> > > >> >> > [perf1,40] -> List(2, 1, 0), [perf1,38] -> List(0, 1, 2),
> > > [perf1,15]
> > > >> ->
> > > >> >> > List(1, 0, 2), [perf1,21] -> List(1, 0, 2))
> > > >> >> >
> > > >> >> > But still nothing changes. I use
> ~/kafka-src/bin/kafka-topics.sh
> > > >> >> > --zookeeper 10.80.42.147:2181 --describe --topic perf1 to
> check
> > > >> leaders.
> > > >> >> >
> > > >> >> > Thanks.
> > > >> >>
> > > >>
> > >
> >
>
Re: partition reassignment
Posted by Jun Rao <ju...@gmail.com>.
Make sure that there is no under replicated partitions (use the
--under-replicated option in the list topic command) before you run that
tool.
Thanks,
Jun
On Wed, Oct 16, 2013 at 12:29 AM, Kane Kane <ka...@gmail.com> wrote:
> Yes, thanks, looks like that's what i need, do you know why it tends to
> choose the leader for all partitions on the single broker, despite I have
> 3?
>
>
> On Wed, Oct 16, 2013 at 12:19 AM, Joel Koshy <jj...@gmail.com> wrote:
>
> > Did the reassignment complete? If the assigned replicas are in ISR and
> > the preferred replicas for the partitions are evenly distributed
> > across the brokers (which seems to be a case on a cursory glance of
> > your assignment) you can use this tool:
> >
> >
> https://cwiki.apache.org/confluence/display/KAFKA/Replication+tools#Replicationtools-2.PreferredReplicaLeaderElectionTool
> >
> > On Wed, Oct 16, 2013 at 12:15 AM, Kane Kane <ka...@gmail.com>
> wrote:
> > > Oh i see, what is the better way to initiate the leader change? As I
> told
> > > somehow all my partitions have the same leader for some reason. I have
> 3
> > > brokers and all partitions have leader on single one.
> > >
> > >
> > > On Wed, Oct 16, 2013 at 12:04 AM, Joel Koshy <jj...@gmail.com>
> > wrote:
> > >
> > >> For a leader change yes, but this is partition reassignment which
> > >> completes when all the reassigned replicas are in sync with the
> > >> original replica(s). You can check the status of the command using the
> > >> option I mentioned earlier.
> > >>
> > >> On Tue, Oct 15, 2013 at 7:02 PM, Kane Kane <ka...@gmail.com>
> > wrote:
> > >> > I thought if i have all replicas in sync, leader change should be
> much
> > >> > faster?
> > >> >
> > >> >
> > >> > On Tue, Oct 15, 2013 at 5:12 PM, Joel Koshy <jj...@gmail.com>
> > wrote:
> > >> >
> > >> >> Depending on how much data there is in those partitions it can
> take a
> > >> >> while for reassignment to actually complete. You will need to use
> the
> > >> >> --status-check-json-file option of the reassign partitions command
> to
> > >> >> determine whether partition reassignment has completed or not.
> > >> >>
> > >> >> Joel
> > >> >>
> > >> >>
> > >> >> On Tue, Oct 15, 2013 at 3:46 PM, Kane Kane <ka...@gmail.com>
> > >> wrote:
> > >> >> > I have 3 brokers and a topic with replication factor of 3.
> > >> >> > Somehow all partitions ended up being on the same broker.
> > >> >> > I've created topic with 3 brokers alive, and they didn't die
> since
> > >> then.
> > >> >> >
> > >> >> > Even when i try to reassign it:
> > >> >> > bin/kafka-reassign-partitions.sh --zookeeper
> > >> >> > 10.80.42.147:2181--broker-list 0,1,2 --topics-to-move-json-file
> > >> >> > ~/reassign.txt --execute
> > >> >> >
> > >> >> > The leader of all partitions after that is still the single
> broker
> > >> (first
> > >> >> > one).
> > >> >> > This is how my json file looks like:
> > >> >> > {"topics":
> > >> >> > [{"topic": "perf1"}],
> > >> >> > "version":1
> > >> >> > }
> > >> >> >
> > >> >> > The command reports success:
> > >> >> > Successfully started reassignment of partitions Map([perf1,33] ->
> > >> List(1,
> > >> >> > 0, 2), [perf1,13] -> List(2, 0, 1), [perf1,28] -> List(2, 1, 0),
> > >> >> [perf1,20]
> > >> >> > -> List(0, 1, 2), [perf1,5] -> List(0, 2, 1), [perf1,14] ->
> > List(0, 1,
> > >> >> 2),
> > >> >> > [perf1,39] -> List(1, 0, 2), [perf1,19] -> List(2, 0, 1),
> > [perf1,25]
> > >> ->
> > >> >> > List(2, 0, 1), [perf1,43] -> List(2, 0, 1), [perf1,11] -> List(0,
> > 2,
> > >> 1),
> > >> >> > [perf1,8] -> List(0, 1, 2), [perf1,22] -> List(2, 1, 0),
> > [perf1,16] ->
> > >> >> > List(2, 1, 0), [perf1,26] -> List(0, 1, 2), [perf1,41] -> List(0,
> > 2,
> > >> 1),
> > >> >> > [perf1,9] -> List(1, 0, 2), [perf1,27] -> List(1, 0, 2),
> > [perf1,44] ->
> > >> >> > List(0, 1, 2), [perf1,34] -> List(2, 1, 0), [perf1,6] -> List(1,
> 2,
> > >> 0),
> > >> >> > [perf1,1] -> List(2, 0, 1), [perf1,37] -> List(2, 0, 1),
> > [perf1,24] ->
> > >> >> > List(1, 2, 0), [perf1,29] -> List(0, 2, 1), [perf1,32] -> List(0,
> > 1,
> > >> 2),
> > >> >> > [perf1,7] -> List(2, 0, 1), [perf1,17] -> List(0, 2, 1),
> > [perf1,36] ->
> > >> >> > List(1, 2, 0), [perf1,0] -> List(1, 2, 0), [perf1,42] -> List(1,
> 2,
> > >> 0),
> > >> >> > [perf1,4] -> List(2, 1, 0), [perf1,10] -> List(2, 1, 0),
> > [perf1,30] ->
> > >> >> > List(1, 2, 0), [perf1,23] -> List(0, 2, 1), [perf1,18] -> List(1,
> > 2,
> > >> 0),
> > >> >> > [perf1,3] -> List(1, 0, 2), [perf1,35] -> List(0, 2, 1),
> > [perf1,31] ->
> > >> >> > List(2, 0, 1), [perf1,12] -> List(1, 2, 0), [perf1,2] -> List(0,
> 1,
> > >> 2),
> > >> >> > [perf1,40] -> List(2, 1, 0), [perf1,38] -> List(0, 1, 2),
> > [perf1,15]
> > >> ->
> > >> >> > List(1, 0, 2), [perf1,21] -> List(1, 0, 2))
> > >> >> >
> > >> >> > But still nothing changes. I use ~/kafka-src/bin/kafka-topics.sh
> > >> >> > --zookeeper 10.80.42.147:2181 --describe --topic perf1 to check
> > >> leaders.
> > >> >> >
> > >> >> > Thanks.
> > >> >>
> > >>
> >
>
Re: partition reassignment
Posted by "hsy541@gmail.com" <hs...@gmail.com>.
There is a ticket for auto-rebalancing, hopefully they'll do auto
redistribution soon
https://issues.apache.org/jira/browse/KAFKA-930
On Wed, Oct 16, 2013 at 12:29 AM, Kane Kane <ka...@gmail.com> wrote:
> Yes, thanks, looks like that's what i need, do you know why it tends to
> choose the leader for all partitions on the single broker, despite I have
> 3?
>
>
> On Wed, Oct 16, 2013 at 12:19 AM, Joel Koshy <jj...@gmail.com> wrote:
>
> > Did the reassignment complete? If the assigned replicas are in ISR and
> > the preferred replicas for the partitions are evenly distributed
> > across the brokers (which seems to be a case on a cursory glance of
> > your assignment) you can use this tool:
> >
> >
> https://cwiki.apache.org/confluence/display/KAFKA/Replication+tools#Replicationtools-2.PreferredReplicaLeaderElectionTool
> >
> > On Wed, Oct 16, 2013 at 12:15 AM, Kane Kane <ka...@gmail.com>
> wrote:
> > > Oh i see, what is the better way to initiate the leader change? As I
> told
> > > somehow all my partitions have the same leader for some reason. I have
> 3
> > > brokers and all partitions have leader on single one.
> > >
> > >
> > > On Wed, Oct 16, 2013 at 12:04 AM, Joel Koshy <jj...@gmail.com>
> > wrote:
> > >
> > >> For a leader change yes, but this is partition reassignment which
> > >> completes when all the reassigned replicas are in sync with the
> > >> original replica(s). You can check the status of the command using the
> > >> option I mentioned earlier.
> > >>
> > >> On Tue, Oct 15, 2013 at 7:02 PM, Kane Kane <ka...@gmail.com>
> > wrote:
> > >> > I thought if i have all replicas in sync, leader change should be
> much
> > >> > faster?
> > >> >
> > >> >
> > >> > On Tue, Oct 15, 2013 at 5:12 PM, Joel Koshy <jj...@gmail.com>
> > wrote:
> > >> >
> > >> >> Depending on how much data there is in those partitions it can
> take a
> > >> >> while for reassignment to actually complete. You will need to use
> the
> > >> >> --status-check-json-file option of the reassign partitions command
> to
> > >> >> determine whether partition reassignment has completed or not.
> > >> >>
> > >> >> Joel
> > >> >>
> > >> >>
> > >> >> On Tue, Oct 15, 2013 at 3:46 PM, Kane Kane <ka...@gmail.com>
> > >> wrote:
> > >> >> > I have 3 brokers and a topic with replication factor of 3.
> > >> >> > Somehow all partitions ended up being on the same broker.
> > >> >> > I've created topic with 3 brokers alive, and they didn't die
> since
> > >> then.
> > >> >> >
> > >> >> > Even when i try to reassign it:
> > >> >> > bin/kafka-reassign-partitions.sh --zookeeper
> > >> >> > 10.80.42.147:2181--broker-list 0,1,2 --topics-to-move-json-file
> > >> >> > ~/reassign.txt --execute
> > >> >> >
> > >> >> > The leader of all partitions after that is still the single
> broker
> > >> (first
> > >> >> > one).
> > >> >> > This is how my json file looks like:
> > >> >> > {"topics":
> > >> >> > [{"topic": "perf1"}],
> > >> >> > "version":1
> > >> >> > }
> > >> >> >
> > >> >> > The command reports success:
> > >> >> > Successfully started reassignment of partitions Map([perf1,33] ->
> > >> List(1,
> > >> >> > 0, 2), [perf1,13] -> List(2, 0, 1), [perf1,28] -> List(2, 1, 0),
> > >> >> [perf1,20]
> > >> >> > -> List(0, 1, 2), [perf1,5] -> List(0, 2, 1), [perf1,14] ->
> > List(0, 1,
> > >> >> 2),
> > >> >> > [perf1,39] -> List(1, 0, 2), [perf1,19] -> List(2, 0, 1),
> > [perf1,25]
> > >> ->
> > >> >> > List(2, 0, 1), [perf1,43] -> List(2, 0, 1), [perf1,11] -> List(0,
> > 2,
> > >> 1),
> > >> >> > [perf1,8] -> List(0, 1, 2), [perf1,22] -> List(2, 1, 0),
> > [perf1,16] ->
> > >> >> > List(2, 1, 0), [perf1,26] -> List(0, 1, 2), [perf1,41] -> List(0,
> > 2,
> > >> 1),
> > >> >> > [perf1,9] -> List(1, 0, 2), [perf1,27] -> List(1, 0, 2),
> > [perf1,44] ->
> > >> >> > List(0, 1, 2), [perf1,34] -> List(2, 1, 0), [perf1,6] -> List(1,
> 2,
> > >> 0),
> > >> >> > [perf1,1] -> List(2, 0, 1), [perf1,37] -> List(2, 0, 1),
> > [perf1,24] ->
> > >> >> > List(1, 2, 0), [perf1,29] -> List(0, 2, 1), [perf1,32] -> List(0,
> > 1,
> > >> 2),
> > >> >> > [perf1,7] -> List(2, 0, 1), [perf1,17] -> List(0, 2, 1),
> > [perf1,36] ->
> > >> >> > List(1, 2, 0), [perf1,0] -> List(1, 2, 0), [perf1,42] -> List(1,
> 2,
> > >> 0),
> > >> >> > [perf1,4] -> List(2, 1, 0), [perf1,10] -> List(2, 1, 0),
> > [perf1,30] ->
> > >> >> > List(1, 2, 0), [perf1,23] -> List(0, 2, 1), [perf1,18] -> List(1,
> > 2,
> > >> 0),
> > >> >> > [perf1,3] -> List(1, 0, 2), [perf1,35] -> List(0, 2, 1),
> > [perf1,31] ->
> > >> >> > List(2, 0, 1), [perf1,12] -> List(1, 2, 0), [perf1,2] -> List(0,
> 1,
> > >> 2),
> > >> >> > [perf1,40] -> List(2, 1, 0), [perf1,38] -> List(0, 1, 2),
> > [perf1,15]
> > >> ->
> > >> >> > List(1, 0, 2), [perf1,21] -> List(1, 0, 2))
> > >> >> >
> > >> >> > But still nothing changes. I use ~/kafka-src/bin/kafka-topics.sh
> > >> >> > --zookeeper 10.80.42.147:2181 --describe --topic perf1 to check
> > >> leaders.
> > >> >> >
> > >> >> > Thanks.
> > >> >>
> > >>
> >
>
Re: partition reassignment
Posted by Kane Kane <ka...@gmail.com>.
Yes, thanks, looks like that's what i need, do you know why it tends to
choose the leader for all partitions on the single broker, despite I have 3?
On Wed, Oct 16, 2013 at 12:19 AM, Joel Koshy <jj...@gmail.com> wrote:
> Did the reassignment complete? If the assigned replicas are in ISR and
> the preferred replicas for the partitions are evenly distributed
> across the brokers (which seems to be a case on a cursory glance of
> your assignment) you can use this tool:
>
> https://cwiki.apache.org/confluence/display/KAFKA/Replication+tools#Replicationtools-2.PreferredReplicaLeaderElectionTool
>
> On Wed, Oct 16, 2013 at 12:15 AM, Kane Kane <ka...@gmail.com> wrote:
> > Oh i see, what is the better way to initiate the leader change? As I told
> > somehow all my partitions have the same leader for some reason. I have 3
> > brokers and all partitions have leader on single one.
> >
> >
> > On Wed, Oct 16, 2013 at 12:04 AM, Joel Koshy <jj...@gmail.com>
> wrote:
> >
> >> For a leader change yes, but this is partition reassignment which
> >> completes when all the reassigned replicas are in sync with the
> >> original replica(s). You can check the status of the command using the
> >> option I mentioned earlier.
> >>
> >> On Tue, Oct 15, 2013 at 7:02 PM, Kane Kane <ka...@gmail.com>
> wrote:
> >> > I thought if i have all replicas in sync, leader change should be much
> >> > faster?
> >> >
> >> >
> >> > On Tue, Oct 15, 2013 at 5:12 PM, Joel Koshy <jj...@gmail.com>
> wrote:
> >> >
> >> >> Depending on how much data there is in those partitions it can take a
> >> >> while for reassignment to actually complete. You will need to use the
> >> >> --status-check-json-file option of the reassign partitions command to
> >> >> determine whether partition reassignment has completed or not.
> >> >>
> >> >> Joel
> >> >>
> >> >>
> >> >> On Tue, Oct 15, 2013 at 3:46 PM, Kane Kane <ka...@gmail.com>
> >> wrote:
> >> >> > I have 3 brokers and a topic with replication factor of 3.
> >> >> > Somehow all partitions ended up being on the same broker.
> >> >> > I've created topic with 3 brokers alive, and they didn't die since
> >> then.
> >> >> >
> >> >> > Even when i try to reassign it:
> >> >> > bin/kafka-reassign-partitions.sh --zookeeper
> >> >> > 10.80.42.147:2181--broker-list 0,1,2 --topics-to-move-json-file
> >> >> > ~/reassign.txt --execute
> >> >> >
> >> >> > The leader of all partitions after that is still the single broker
> >> (first
> >> >> > one).
> >> >> > This is how my json file looks like:
> >> >> > {"topics":
> >> >> > [{"topic": "perf1"}],
> >> >> > "version":1
> >> >> > }
> >> >> >
> >> >> > The command reports success:
> >> >> > Successfully started reassignment of partitions Map([perf1,33] ->
> >> List(1,
> >> >> > 0, 2), [perf1,13] -> List(2, 0, 1), [perf1,28] -> List(2, 1, 0),
> >> >> [perf1,20]
> >> >> > -> List(0, 1, 2), [perf1,5] -> List(0, 2, 1), [perf1,14] ->
> List(0, 1,
> >> >> 2),
> >> >> > [perf1,39] -> List(1, 0, 2), [perf1,19] -> List(2, 0, 1),
> [perf1,25]
> >> ->
> >> >> > List(2, 0, 1), [perf1,43] -> List(2, 0, 1), [perf1,11] -> List(0,
> 2,
> >> 1),
> >> >> > [perf1,8] -> List(0, 1, 2), [perf1,22] -> List(2, 1, 0),
> [perf1,16] ->
> >> >> > List(2, 1, 0), [perf1,26] -> List(0, 1, 2), [perf1,41] -> List(0,
> 2,
> >> 1),
> >> >> > [perf1,9] -> List(1, 0, 2), [perf1,27] -> List(1, 0, 2),
> [perf1,44] ->
> >> >> > List(0, 1, 2), [perf1,34] -> List(2, 1, 0), [perf1,6] -> List(1, 2,
> >> 0),
> >> >> > [perf1,1] -> List(2, 0, 1), [perf1,37] -> List(2, 0, 1),
> [perf1,24] ->
> >> >> > List(1, 2, 0), [perf1,29] -> List(0, 2, 1), [perf1,32] -> List(0,
> 1,
> >> 2),
> >> >> > [perf1,7] -> List(2, 0, 1), [perf1,17] -> List(0, 2, 1),
> [perf1,36] ->
> >> >> > List(1, 2, 0), [perf1,0] -> List(1, 2, 0), [perf1,42] -> List(1, 2,
> >> 0),
> >> >> > [perf1,4] -> List(2, 1, 0), [perf1,10] -> List(2, 1, 0),
> [perf1,30] ->
> >> >> > List(1, 2, 0), [perf1,23] -> List(0, 2, 1), [perf1,18] -> List(1,
> 2,
> >> 0),
> >> >> > [perf1,3] -> List(1, 0, 2), [perf1,35] -> List(0, 2, 1),
> [perf1,31] ->
> >> >> > List(2, 0, 1), [perf1,12] -> List(1, 2, 0), [perf1,2] -> List(0, 1,
> >> 2),
> >> >> > [perf1,40] -> List(2, 1, 0), [perf1,38] -> List(0, 1, 2),
> [perf1,15]
> >> ->
> >> >> > List(1, 0, 2), [perf1,21] -> List(1, 0, 2))
> >> >> >
> >> >> > But still nothing changes. I use ~/kafka-src/bin/kafka-topics.sh
> >> >> > --zookeeper 10.80.42.147:2181 --describe --topic perf1 to check
> >> leaders.
> >> >> >
> >> >> > Thanks.
> >> >>
> >>
>
Re: partition reassignment
Posted by Joel Koshy <jj...@gmail.com>.
Did the reassignment complete? If the assigned replicas are in ISR and
the preferred replicas for the partitions are evenly distributed
across the brokers (which seems to be a case on a cursory glance of
your assignment) you can use this tool:
https://cwiki.apache.org/confluence/display/KAFKA/Replication+tools#Replicationtools-2.PreferredReplicaLeaderElectionTool
On Wed, Oct 16, 2013 at 12:15 AM, Kane Kane <ka...@gmail.com> wrote:
> Oh i see, what is the better way to initiate the leader change? As I told
> somehow all my partitions have the same leader for some reason. I have 3
> brokers and all partitions have leader on single one.
>
>
> On Wed, Oct 16, 2013 at 12:04 AM, Joel Koshy <jj...@gmail.com> wrote:
>
>> For a leader change yes, but this is partition reassignment which
>> completes when all the reassigned replicas are in sync with the
>> original replica(s). You can check the status of the command using the
>> option I mentioned earlier.
>>
>> On Tue, Oct 15, 2013 at 7:02 PM, Kane Kane <ka...@gmail.com> wrote:
>> > I thought if i have all replicas in sync, leader change should be much
>> > faster?
>> >
>> >
>> > On Tue, Oct 15, 2013 at 5:12 PM, Joel Koshy <jj...@gmail.com> wrote:
>> >
>> >> Depending on how much data there is in those partitions it can take a
>> >> while for reassignment to actually complete. You will need to use the
>> >> --status-check-json-file option of the reassign partitions command to
>> >> determine whether partition reassignment has completed or not.
>> >>
>> >> Joel
>> >>
>> >>
>> >> On Tue, Oct 15, 2013 at 3:46 PM, Kane Kane <ka...@gmail.com>
>> wrote:
>> >> > I have 3 brokers and a topic with replication factor of 3.
>> >> > Somehow all partitions ended up being on the same broker.
>> >> > I've created topic with 3 brokers alive, and they didn't die since
>> then.
>> >> >
>> >> > Even when i try to reassign it:
>> >> > bin/kafka-reassign-partitions.sh --zookeeper
>> >> > 10.80.42.147:2181--broker-list 0,1,2 --topics-to-move-json-file
>> >> > ~/reassign.txt --execute
>> >> >
>> >> > The leader of all partitions after that is still the single broker
>> (first
>> >> > one).
>> >> > This is how my json file looks like:
>> >> > {"topics":
>> >> > [{"topic": "perf1"}],
>> >> > "version":1
>> >> > }
>> >> >
>> >> > The command reports success:
>> >> > Successfully started reassignment of partitions Map([perf1,33] ->
>> List(1,
>> >> > 0, 2), [perf1,13] -> List(2, 0, 1), [perf1,28] -> List(2, 1, 0),
>> >> [perf1,20]
>> >> > -> List(0, 1, 2), [perf1,5] -> List(0, 2, 1), [perf1,14] -> List(0, 1,
>> >> 2),
>> >> > [perf1,39] -> List(1, 0, 2), [perf1,19] -> List(2, 0, 1), [perf1,25]
>> ->
>> >> > List(2, 0, 1), [perf1,43] -> List(2, 0, 1), [perf1,11] -> List(0, 2,
>> 1),
>> >> > [perf1,8] -> List(0, 1, 2), [perf1,22] -> List(2, 1, 0), [perf1,16] ->
>> >> > List(2, 1, 0), [perf1,26] -> List(0, 1, 2), [perf1,41] -> List(0, 2,
>> 1),
>> >> > [perf1,9] -> List(1, 0, 2), [perf1,27] -> List(1, 0, 2), [perf1,44] ->
>> >> > List(0, 1, 2), [perf1,34] -> List(2, 1, 0), [perf1,6] -> List(1, 2,
>> 0),
>> >> > [perf1,1] -> List(2, 0, 1), [perf1,37] -> List(2, 0, 1), [perf1,24] ->
>> >> > List(1, 2, 0), [perf1,29] -> List(0, 2, 1), [perf1,32] -> List(0, 1,
>> 2),
>> >> > [perf1,7] -> List(2, 0, 1), [perf1,17] -> List(0, 2, 1), [perf1,36] ->
>> >> > List(1, 2, 0), [perf1,0] -> List(1, 2, 0), [perf1,42] -> List(1, 2,
>> 0),
>> >> > [perf1,4] -> List(2, 1, 0), [perf1,10] -> List(2, 1, 0), [perf1,30] ->
>> >> > List(1, 2, 0), [perf1,23] -> List(0, 2, 1), [perf1,18] -> List(1, 2,
>> 0),
>> >> > [perf1,3] -> List(1, 0, 2), [perf1,35] -> List(0, 2, 1), [perf1,31] ->
>> >> > List(2, 0, 1), [perf1,12] -> List(1, 2, 0), [perf1,2] -> List(0, 1,
>> 2),
>> >> > [perf1,40] -> List(2, 1, 0), [perf1,38] -> List(0, 1, 2), [perf1,15]
>> ->
>> >> > List(1, 0, 2), [perf1,21] -> List(1, 0, 2))
>> >> >
>> >> > But still nothing changes. I use ~/kafka-src/bin/kafka-topics.sh
>> >> > --zookeeper 10.80.42.147:2181 --describe --topic perf1 to check
>> leaders.
>> >> >
>> >> > Thanks.
>> >>
>>
Re: partition reassignment
Posted by Kane Kane <ka...@gmail.com>.
Oh i see, what is the better way to initiate the leader change? As I told
somehow all my partitions have the same leader for some reason. I have 3
brokers and all partitions have leader on single one.
On Wed, Oct 16, 2013 at 12:04 AM, Joel Koshy <jj...@gmail.com> wrote:
> For a leader change yes, but this is partition reassignment which
> completes when all the reassigned replicas are in sync with the
> original replica(s). You can check the status of the command using the
> option I mentioned earlier.
>
> On Tue, Oct 15, 2013 at 7:02 PM, Kane Kane <ka...@gmail.com> wrote:
> > I thought if i have all replicas in sync, leader change should be much
> > faster?
> >
> >
> > On Tue, Oct 15, 2013 at 5:12 PM, Joel Koshy <jj...@gmail.com> wrote:
> >
> >> Depending on how much data there is in those partitions it can take a
> >> while for reassignment to actually complete. You will need to use the
> >> --status-check-json-file option of the reassign partitions command to
> >> determine whether partition reassignment has completed or not.
> >>
> >> Joel
> >>
> >>
> >> On Tue, Oct 15, 2013 at 3:46 PM, Kane Kane <ka...@gmail.com>
> wrote:
> >> > I have 3 brokers and a topic with replication factor of 3.
> >> > Somehow all partitions ended up being on the same broker.
> >> > I've created topic with 3 brokers alive, and they didn't die since
> then.
> >> >
> >> > Even when i try to reassign it:
> >> > bin/kafka-reassign-partitions.sh --zookeeper
> >> > 10.80.42.147:2181--broker-list 0,1,2 --topics-to-move-json-file
> >> > ~/reassign.txt --execute
> >> >
> >> > The leader of all partitions after that is still the single broker
> (first
> >> > one).
> >> > This is how my json file looks like:
> >> > {"topics":
> >> > [{"topic": "perf1"}],
> >> > "version":1
> >> > }
> >> >
> >> > The command reports success:
> >> > Successfully started reassignment of partitions Map([perf1,33] ->
> List(1,
> >> > 0, 2), [perf1,13] -> List(2, 0, 1), [perf1,28] -> List(2, 1, 0),
> >> [perf1,20]
> >> > -> List(0, 1, 2), [perf1,5] -> List(0, 2, 1), [perf1,14] -> List(0, 1,
> >> 2),
> >> > [perf1,39] -> List(1, 0, 2), [perf1,19] -> List(2, 0, 1), [perf1,25]
> ->
> >> > List(2, 0, 1), [perf1,43] -> List(2, 0, 1), [perf1,11] -> List(0, 2,
> 1),
> >> > [perf1,8] -> List(0, 1, 2), [perf1,22] -> List(2, 1, 0), [perf1,16] ->
> >> > List(2, 1, 0), [perf1,26] -> List(0, 1, 2), [perf1,41] -> List(0, 2,
> 1),
> >> > [perf1,9] -> List(1, 0, 2), [perf1,27] -> List(1, 0, 2), [perf1,44] ->
> >> > List(0, 1, 2), [perf1,34] -> List(2, 1, 0), [perf1,6] -> List(1, 2,
> 0),
> >> > [perf1,1] -> List(2, 0, 1), [perf1,37] -> List(2, 0, 1), [perf1,24] ->
> >> > List(1, 2, 0), [perf1,29] -> List(0, 2, 1), [perf1,32] -> List(0, 1,
> 2),
> >> > [perf1,7] -> List(2, 0, 1), [perf1,17] -> List(0, 2, 1), [perf1,36] ->
> >> > List(1, 2, 0), [perf1,0] -> List(1, 2, 0), [perf1,42] -> List(1, 2,
> 0),
> >> > [perf1,4] -> List(2, 1, 0), [perf1,10] -> List(2, 1, 0), [perf1,30] ->
> >> > List(1, 2, 0), [perf1,23] -> List(0, 2, 1), [perf1,18] -> List(1, 2,
> 0),
> >> > [perf1,3] -> List(1, 0, 2), [perf1,35] -> List(0, 2, 1), [perf1,31] ->
> >> > List(2, 0, 1), [perf1,12] -> List(1, 2, 0), [perf1,2] -> List(0, 1,
> 2),
> >> > [perf1,40] -> List(2, 1, 0), [perf1,38] -> List(0, 1, 2), [perf1,15]
> ->
> >> > List(1, 0, 2), [perf1,21] -> List(1, 0, 2))
> >> >
> >> > But still nothing changes. I use ~/kafka-src/bin/kafka-topics.sh
> >> > --zookeeper 10.80.42.147:2181 --describe --topic perf1 to check
> leaders.
> >> >
> >> > Thanks.
> >>
>
Re: partition reassignment
Posted by Joel Koshy <jj...@gmail.com>.
For a leader change yes, but this is partition reassignment which
completes when all the reassigned replicas are in sync with the
original replica(s). You can check the status of the command using the
option I mentioned earlier.
On Tue, Oct 15, 2013 at 7:02 PM, Kane Kane <ka...@gmail.com> wrote:
> I thought if i have all replicas in sync, leader change should be much
> faster?
>
>
> On Tue, Oct 15, 2013 at 5:12 PM, Joel Koshy <jj...@gmail.com> wrote:
>
>> Depending on how much data there is in those partitions it can take a
>> while for reassignment to actually complete. You will need to use the
>> --status-check-json-file option of the reassign partitions command to
>> determine whether partition reassignment has completed or not.
>>
>> Joel
>>
>>
>> On Tue, Oct 15, 2013 at 3:46 PM, Kane Kane <ka...@gmail.com> wrote:
>> > I have 3 brokers and a topic with replication factor of 3.
>> > Somehow all partitions ended up being on the same broker.
>> > I've created topic with 3 brokers alive, and they didn't die since then.
>> >
>> > Even when i try to reassign it:
>> > bin/kafka-reassign-partitions.sh --zookeeper
>> > 10.80.42.147:2181--broker-list 0,1,2 --topics-to-move-json-file
>> > ~/reassign.txt --execute
>> >
>> > The leader of all partitions after that is still the single broker (first
>> > one).
>> > This is how my json file looks like:
>> > {"topics":
>> > [{"topic": "perf1"}],
>> > "version":1
>> > }
>> >
>> > The command reports success:
>> > Successfully started reassignment of partitions Map([perf1,33] -> List(1,
>> > 0, 2), [perf1,13] -> List(2, 0, 1), [perf1,28] -> List(2, 1, 0),
>> [perf1,20]
>> > -> List(0, 1, 2), [perf1,5] -> List(0, 2, 1), [perf1,14] -> List(0, 1,
>> 2),
>> > [perf1,39] -> List(1, 0, 2), [perf1,19] -> List(2, 0, 1), [perf1,25] ->
>> > List(2, 0, 1), [perf1,43] -> List(2, 0, 1), [perf1,11] -> List(0, 2, 1),
>> > [perf1,8] -> List(0, 1, 2), [perf1,22] -> List(2, 1, 0), [perf1,16] ->
>> > List(2, 1, 0), [perf1,26] -> List(0, 1, 2), [perf1,41] -> List(0, 2, 1),
>> > [perf1,9] -> List(1, 0, 2), [perf1,27] -> List(1, 0, 2), [perf1,44] ->
>> > List(0, 1, 2), [perf1,34] -> List(2, 1, 0), [perf1,6] -> List(1, 2, 0),
>> > [perf1,1] -> List(2, 0, 1), [perf1,37] -> List(2, 0, 1), [perf1,24] ->
>> > List(1, 2, 0), [perf1,29] -> List(0, 2, 1), [perf1,32] -> List(0, 1, 2),
>> > [perf1,7] -> List(2, 0, 1), [perf1,17] -> List(0, 2, 1), [perf1,36] ->
>> > List(1, 2, 0), [perf1,0] -> List(1, 2, 0), [perf1,42] -> List(1, 2, 0),
>> > [perf1,4] -> List(2, 1, 0), [perf1,10] -> List(2, 1, 0), [perf1,30] ->
>> > List(1, 2, 0), [perf1,23] -> List(0, 2, 1), [perf1,18] -> List(1, 2, 0),
>> > [perf1,3] -> List(1, 0, 2), [perf1,35] -> List(0, 2, 1), [perf1,31] ->
>> > List(2, 0, 1), [perf1,12] -> List(1, 2, 0), [perf1,2] -> List(0, 1, 2),
>> > [perf1,40] -> List(2, 1, 0), [perf1,38] -> List(0, 1, 2), [perf1,15] ->
>> > List(1, 0, 2), [perf1,21] -> List(1, 0, 2))
>> >
>> > But still nothing changes. I use ~/kafka-src/bin/kafka-topics.sh
>> > --zookeeper 10.80.42.147:2181 --describe --topic perf1 to check leaders.
>> >
>> > Thanks.
>>
Re: partition reassignment
Posted by Kane Kane <ka...@gmail.com>.
I thought if i have all replicas in sync, leader change should be much
faster?
On Tue, Oct 15, 2013 at 5:12 PM, Joel Koshy <jj...@gmail.com> wrote:
> Depending on how much data there is in those partitions it can take a
> while for reassignment to actually complete. You will need to use the
> --status-check-json-file option of the reassign partitions command to
> determine whether partition reassignment has completed or not.
>
> Joel
>
>
> On Tue, Oct 15, 2013 at 3:46 PM, Kane Kane <ka...@gmail.com> wrote:
> > I have 3 brokers and a topic with replication factor of 3.
> > Somehow all partitions ended up being on the same broker.
> > I've created topic with 3 brokers alive, and they didn't die since then.
> >
> > Even when i try to reassign it:
> > bin/kafka-reassign-partitions.sh --zookeeper
> > 10.80.42.147:2181--broker-list 0,1,2 --topics-to-move-json-file
> > ~/reassign.txt --execute
> >
> > The leader of all partitions after that is still the single broker (first
> > one).
> > This is how my json file looks like:
> > {"topics":
> > [{"topic": "perf1"}],
> > "version":1
> > }
> >
> > The command reports success:
> > Successfully started reassignment of partitions Map([perf1,33] -> List(1,
> > 0, 2), [perf1,13] -> List(2, 0, 1), [perf1,28] -> List(2, 1, 0),
> [perf1,20]
> > -> List(0, 1, 2), [perf1,5] -> List(0, 2, 1), [perf1,14] -> List(0, 1,
> 2),
> > [perf1,39] -> List(1, 0, 2), [perf1,19] -> List(2, 0, 1), [perf1,25] ->
> > List(2, 0, 1), [perf1,43] -> List(2, 0, 1), [perf1,11] -> List(0, 2, 1),
> > [perf1,8] -> List(0, 1, 2), [perf1,22] -> List(2, 1, 0), [perf1,16] ->
> > List(2, 1, 0), [perf1,26] -> List(0, 1, 2), [perf1,41] -> List(0, 2, 1),
> > [perf1,9] -> List(1, 0, 2), [perf1,27] -> List(1, 0, 2), [perf1,44] ->
> > List(0, 1, 2), [perf1,34] -> List(2, 1, 0), [perf1,6] -> List(1, 2, 0),
> > [perf1,1] -> List(2, 0, 1), [perf1,37] -> List(2, 0, 1), [perf1,24] ->
> > List(1, 2, 0), [perf1,29] -> List(0, 2, 1), [perf1,32] -> List(0, 1, 2),
> > [perf1,7] -> List(2, 0, 1), [perf1,17] -> List(0, 2, 1), [perf1,36] ->
> > List(1, 2, 0), [perf1,0] -> List(1, 2, 0), [perf1,42] -> List(1, 2, 0),
> > [perf1,4] -> List(2, 1, 0), [perf1,10] -> List(2, 1, 0), [perf1,30] ->
> > List(1, 2, 0), [perf1,23] -> List(0, 2, 1), [perf1,18] -> List(1, 2, 0),
> > [perf1,3] -> List(1, 0, 2), [perf1,35] -> List(0, 2, 1), [perf1,31] ->
> > List(2, 0, 1), [perf1,12] -> List(1, 2, 0), [perf1,2] -> List(0, 1, 2),
> > [perf1,40] -> List(2, 1, 0), [perf1,38] -> List(0, 1, 2), [perf1,15] ->
> > List(1, 0, 2), [perf1,21] -> List(1, 0, 2))
> >
> > But still nothing changes. I use ~/kafka-src/bin/kafka-topics.sh
> > --zookeeper 10.80.42.147:2181 --describe --topic perf1 to check leaders.
> >
> > Thanks.
>
Re: partition reassignment
Posted by Joel Koshy <jj...@gmail.com>.
Depending on how much data there is in those partitions it can take a
while for reassignment to actually complete. You will need to use the
--status-check-json-file option of the reassign partitions command to
determine whether partition reassignment has completed or not.
Joel
On Tue, Oct 15, 2013 at 3:46 PM, Kane Kane <ka...@gmail.com> wrote:
> I have 3 brokers and a topic with replication factor of 3.
> Somehow all partitions ended up being on the same broker.
> I've created topic with 3 brokers alive, and they didn't die since then.
>
> Even when i try to reassign it:
> bin/kafka-reassign-partitions.sh --zookeeper
> 10.80.42.147:2181--broker-list 0,1,2 --topics-to-move-json-file
> ~/reassign.txt --execute
>
> The leader of all partitions after that is still the single broker (first
> one).
> This is how my json file looks like:
> {"topics":
> [{"topic": "perf1"}],
> "version":1
> }
>
> The command reports success:
> Successfully started reassignment of partitions Map([perf1,33] -> List(1,
> 0, 2), [perf1,13] -> List(2, 0, 1), [perf1,28] -> List(2, 1, 0), [perf1,20]
> -> List(0, 1, 2), [perf1,5] -> List(0, 2, 1), [perf1,14] -> List(0, 1, 2),
> [perf1,39] -> List(1, 0, 2), [perf1,19] -> List(2, 0, 1), [perf1,25] ->
> List(2, 0, 1), [perf1,43] -> List(2, 0, 1), [perf1,11] -> List(0, 2, 1),
> [perf1,8] -> List(0, 1, 2), [perf1,22] -> List(2, 1, 0), [perf1,16] ->
> List(2, 1, 0), [perf1,26] -> List(0, 1, 2), [perf1,41] -> List(0, 2, 1),
> [perf1,9] -> List(1, 0, 2), [perf1,27] -> List(1, 0, 2), [perf1,44] ->
> List(0, 1, 2), [perf1,34] -> List(2, 1, 0), [perf1,6] -> List(1, 2, 0),
> [perf1,1] -> List(2, 0, 1), [perf1,37] -> List(2, 0, 1), [perf1,24] ->
> List(1, 2, 0), [perf1,29] -> List(0, 2, 1), [perf1,32] -> List(0, 1, 2),
> [perf1,7] -> List(2, 0, 1), [perf1,17] -> List(0, 2, 1), [perf1,36] ->
> List(1, 2, 0), [perf1,0] -> List(1, 2, 0), [perf1,42] -> List(1, 2, 0),
> [perf1,4] -> List(2, 1, 0), [perf1,10] -> List(2, 1, 0), [perf1,30] ->
> List(1, 2, 0), [perf1,23] -> List(0, 2, 1), [perf1,18] -> List(1, 2, 0),
> [perf1,3] -> List(1, 0, 2), [perf1,35] -> List(0, 2, 1), [perf1,31] ->
> List(2, 0, 1), [perf1,12] -> List(1, 2, 0), [perf1,2] -> List(0, 1, 2),
> [perf1,40] -> List(2, 1, 0), [perf1,38] -> List(0, 1, 2), [perf1,15] ->
> List(1, 0, 2), [perf1,21] -> List(1, 0, 2))
>
> But still nothing changes. I use ~/kafka-src/bin/kafka-topics.sh
> --zookeeper 10.80.42.147:2181 --describe --topic perf1 to check leaders.
>
> Thanks.