You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@kafka.apache.org by Scott Clasen <sc...@heroku.com> on 2013/03/21 20:40:26 UTC
0.8 reassignment issue (built from 7b14ebae3382427b44a928d0b186001735c15efb)
Hi all, Im currently testing out 0.8 failure/recovery stuff. Having an
issue with reassigning a partition,
after making a mistake in my first attempt to reassign, seems like
reassignment is hosed.
Is this known or should I open a ticket?
Have 3 brokers running. Ids 25,26,27
./bin/kafka-create-topic.sh --replica 3 --topic first-cluster-topic
--zookeeper <zk>:2181/kafka
Seems fine, can send/receive, etc..
Kill 27, start 28. Try to reassign the single partition topic with the
following json.
Contains an error. partition should be 0 not 1.
{"partitions":
[{"topic": "first-cluster-topic", "partition": 1, "replicas": [25,26,28] }]
}
./bin/kafka-reassign-partitions.sh --zookeeper ... -path-to-json-file
reassign.json
2013-03-21 12:14:46,170] INFO zookeeper state changed (SyncConnected)
(org.I0Itec.zkclient.ZkClient)
[2013-03-21 12:14:46,310] ERROR Skipping reassignment of partition
[first-cluster-topic,1] since it doesn't exist
(kafka.admin.ReassignPartitionsCommand)
Successfully started reassignment of partitions Map([first-cluster-topic,1]
-> List(25, 26, 28))
[2013-03-21 12:14:46,665] INFO Terminate ZkClient event thread.
(org.I0Itec.zkclient.ZkEventThread)
[2013-03-21 12:14:46,780] INFO Session: 0x13d8a63a3760007 closed
(org.apache.zookeeper.ZooKeeper)
[2013-03-21 12:14:46,780] INFO EventThread shut down
(org.apache.zookeeper.ClientCnxn)
Ok, fix the JSON
{"partitions":
[{"topic": "first-cluster-topic", "partition": 0, "replicas": [25,26,28] }]
}
./bin/kafka-reassign-partitions.sh --zookeeper ... -path-to-json-file
reassign.json
[2013-03-21 12:17:34,367] INFO zookeeper state changed (SyncConnected)
(org.I0Itec.zkclient.ZkClient)
Partitions reassignment failed due to Partition reassignment currently in
progress for Map(). Aborting operation
kafka.common.AdminCommandFailedException: Partition reassignment currently
in progress for Map(). Aborting operation
at
kafka.admin.ReassignPartitionsCommand.reassignPartitions(ReassignPartitionsCommand.scala:91)
at
kafka.admin.ReassignPartitionsCommand$.main(ReassignPartitionsCommand.scala:65)
at
kafka.admin.ReassignPartitionsCommand.main(ReassignPartitionsCommand.scala)
./bin/kafka-check-reassignment-status.sh --zookeeper ...
--path-to-json-file reassign.json
[2013-03-21 12:20:40,607] INFO zookeeper state changed (SyncConnected)
(org.I0Itec.zkclient.ZkClient)
Exception in thread "main" java.lang.ClassCastException:
scala.collection.immutable.Map$Map1 cannot be cast to
[Lscala.collection.Map;
at
kafka.admin.CheckReassignmentStatus$.main(CheckReassignmentStatus.scala:44)
at kafka.admin.CheckReassignmentStatus.main(CheckReassignmentStatus.scala)
Re: 0.8 reassignment issue (built from 7b14ebae3382427b44a928d0b186001735c15efb)
Posted by Scott Clasen <sc...@heroku.com>.
KAFKA-821 Cheers!
On Thu, Mar 21, 2013 at 1:58 PM, Neha Narkhede <ne...@gmail.com>wrote:
> Please can you file a bug, this needs to be fixed.
>
> Thanks
> Neha
>
>
> On Thu, Mar 21, 2013 at 1:50 PM, Scott Clasen <sc...@heroku.com> wrote:
>
> > So, deleting /admin/reassign_partitions from Zookeeper, which had an
> empty
> > array of partitions seemed to fix things. Probably isnt the preferred way
> > though :)
> >
> >
> > On Thu, Mar 21, 2013 at 12:40 PM, Scott Clasen <sc...@heroku.com> wrote:
> >
> > > Hi all, Im currently testing out 0.8 failure/recovery stuff. Having an
> > > issue with reassigning a partition,
> > > after making a mistake in my first attempt to reassign, seems like
> > > reassignment is hosed.
> > >
> > > Is this known or should I open a ticket?
> > >
> > >
> > > Have 3 brokers running. Ids 25,26,27
> > >
> > > ./bin/kafka-create-topic.sh --replica 3 --topic first-cluster-topic
> > > --zookeeper <zk>:2181/kafka
> > >
> > > Seems fine, can send/receive, etc..
> > >
> > > Kill 27, start 28. Try to reassign the single partition topic with the
> > > following json.
> > >
> > > Contains an error. partition should be 0 not 1.
> > >
> > > {"partitions":
> > > [{"topic": "first-cluster-topic", "partition": 1, "replicas":
> [25,26,28]
> > > }]
> > > }
> > >
> > > ./bin/kafka-reassign-partitions.sh --zookeeper ... -path-to-json-file
> > > reassign.json
> > >
> > > 2013-03-21 12:14:46,170] INFO zookeeper state changed (SyncConnected)
> > > (org.I0Itec.zkclient.ZkClient)
> > > [2013-03-21 12:14:46,310] ERROR Skipping reassignment of partition
> > > [first-cluster-topic,1] since it doesn't exist
> > > (kafka.admin.ReassignPartitionsCommand)
> > > Successfully started reassignment of partitions
> > > Map([first-cluster-topic,1] -> List(25, 26, 28))
> > > [2013-03-21 12:14:46,665] INFO Terminate ZkClient event thread.
> > > (org.I0Itec.zkclient.ZkEventThread)
> > > [2013-03-21 12:14:46,780] INFO Session: 0x13d8a63a3760007 closed
> > > (org.apache.zookeeper.ZooKeeper)
> > > [2013-03-21 12:14:46,780] INFO EventThread shut down
> > > (org.apache.zookeeper.ClientCnxn)
> > >
> > > Ok, fix the JSON
> > >
> > > {"partitions":
> > > [{"topic": "first-cluster-topic", "partition": 0, "replicas":
> [25,26,28]
> > > }]
> > > }
> > >
> > > ./bin/kafka-reassign-partitions.sh --zookeeper ... -path-to-json-file
> > > reassign.json
> > >
> > >
> > > [2013-03-21 12:17:34,367] INFO zookeeper state changed (SyncConnected)
> > > (org.I0Itec.zkclient.ZkClient)
> > > Partitions reassignment failed due to Partition reassignment currently
> in
> > > progress for Map(). Aborting operation
> > > kafka.common.AdminCommandFailedException: Partition reassignment
> > currently
> > > in progress for Map(). Aborting operation
> > > at
> > >
> >
> kafka.admin.ReassignPartitionsCommand.reassignPartitions(ReassignPartitionsCommand.scala:91)
> > > at
> > >
> >
> kafka.admin.ReassignPartitionsCommand$.main(ReassignPartitionsCommand.scala:65)
> > > at
> > >
> >
> kafka.admin.ReassignPartitionsCommand.main(ReassignPartitionsCommand.scala)
> > >
> > > ./bin/kafka-check-reassignment-status.sh --zookeeper ...
> > > --path-to-json-file reassign.json
> > >
> > >
> > > [2013-03-21 12:20:40,607] INFO zookeeper state changed (SyncConnected)
> > > (org.I0Itec.zkclient.ZkClient)
> > > Exception in thread "main" java.lang.ClassCastException:
> > > scala.collection.immutable.Map$Map1 cannot be cast to
> > > [Lscala.collection.Map;
> > > at
> > >
> >
> kafka.admin.CheckReassignmentStatus$.main(CheckReassignmentStatus.scala:44)
> > > at
> > kafka.admin.CheckReassignmentStatus.main(CheckReassignmentStatus.scala)
> > >
> > >
> > >
> > >
> > >
> >
>
Re: 0.8 reassignment issue (built from 7b14ebae3382427b44a928d0b186001735c15efb)
Posted by Neha Narkhede <ne...@gmail.com>.
Please can you file a bug, this needs to be fixed.
Thanks
Neha
On Thu, Mar 21, 2013 at 1:50 PM, Scott Clasen <sc...@heroku.com> wrote:
> So, deleting /admin/reassign_partitions from Zookeeper, which had an empty
> array of partitions seemed to fix things. Probably isnt the preferred way
> though :)
>
>
> On Thu, Mar 21, 2013 at 12:40 PM, Scott Clasen <sc...@heroku.com> wrote:
>
> > Hi all, Im currently testing out 0.8 failure/recovery stuff. Having an
> > issue with reassigning a partition,
> > after making a mistake in my first attempt to reassign, seems like
> > reassignment is hosed.
> >
> > Is this known or should I open a ticket?
> >
> >
> > Have 3 brokers running. Ids 25,26,27
> >
> > ./bin/kafka-create-topic.sh --replica 3 --topic first-cluster-topic
> > --zookeeper <zk>:2181/kafka
> >
> > Seems fine, can send/receive, etc..
> >
> > Kill 27, start 28. Try to reassign the single partition topic with the
> > following json.
> >
> > Contains an error. partition should be 0 not 1.
> >
> > {"partitions":
> > [{"topic": "first-cluster-topic", "partition": 1, "replicas": [25,26,28]
> > }]
> > }
> >
> > ./bin/kafka-reassign-partitions.sh --zookeeper ... -path-to-json-file
> > reassign.json
> >
> > 2013-03-21 12:14:46,170] INFO zookeeper state changed (SyncConnected)
> > (org.I0Itec.zkclient.ZkClient)
> > [2013-03-21 12:14:46,310] ERROR Skipping reassignment of partition
> > [first-cluster-topic,1] since it doesn't exist
> > (kafka.admin.ReassignPartitionsCommand)
> > Successfully started reassignment of partitions
> > Map([first-cluster-topic,1] -> List(25, 26, 28))
> > [2013-03-21 12:14:46,665] INFO Terminate ZkClient event thread.
> > (org.I0Itec.zkclient.ZkEventThread)
> > [2013-03-21 12:14:46,780] INFO Session: 0x13d8a63a3760007 closed
> > (org.apache.zookeeper.ZooKeeper)
> > [2013-03-21 12:14:46,780] INFO EventThread shut down
> > (org.apache.zookeeper.ClientCnxn)
> >
> > Ok, fix the JSON
> >
> > {"partitions":
> > [{"topic": "first-cluster-topic", "partition": 0, "replicas": [25,26,28]
> > }]
> > }
> >
> > ./bin/kafka-reassign-partitions.sh --zookeeper ... -path-to-json-file
> > reassign.json
> >
> >
> > [2013-03-21 12:17:34,367] INFO zookeeper state changed (SyncConnected)
> > (org.I0Itec.zkclient.ZkClient)
> > Partitions reassignment failed due to Partition reassignment currently in
> > progress for Map(). Aborting operation
> > kafka.common.AdminCommandFailedException: Partition reassignment
> currently
> > in progress for Map(). Aborting operation
> > at
> >
> kafka.admin.ReassignPartitionsCommand.reassignPartitions(ReassignPartitionsCommand.scala:91)
> > at
> >
> kafka.admin.ReassignPartitionsCommand$.main(ReassignPartitionsCommand.scala:65)
> > at
> >
> kafka.admin.ReassignPartitionsCommand.main(ReassignPartitionsCommand.scala)
> >
> > ./bin/kafka-check-reassignment-status.sh --zookeeper ...
> > --path-to-json-file reassign.json
> >
> >
> > [2013-03-21 12:20:40,607] INFO zookeeper state changed (SyncConnected)
> > (org.I0Itec.zkclient.ZkClient)
> > Exception in thread "main" java.lang.ClassCastException:
> > scala.collection.immutable.Map$Map1 cannot be cast to
> > [Lscala.collection.Map;
> > at
> >
> kafka.admin.CheckReassignmentStatus$.main(CheckReassignmentStatus.scala:44)
> > at
> kafka.admin.CheckReassignmentStatus.main(CheckReassignmentStatus.scala)
> >
> >
> >
> >
> >
>
Re: 0.8 reassignment issue (built from 7b14ebae3382427b44a928d0b186001735c15efb)
Posted by Scott Clasen <sc...@heroku.com>.
So, deleting /admin/reassign_partitions from Zookeeper, which had an empty
array of partitions seemed to fix things. Probably isnt the preferred way
though :)
On Thu, Mar 21, 2013 at 12:40 PM, Scott Clasen <sc...@heroku.com> wrote:
> Hi all, Im currently testing out 0.8 failure/recovery stuff. Having an
> issue with reassigning a partition,
> after making a mistake in my first attempt to reassign, seems like
> reassignment is hosed.
>
> Is this known or should I open a ticket?
>
>
> Have 3 brokers running. Ids 25,26,27
>
> ./bin/kafka-create-topic.sh --replica 3 --topic first-cluster-topic
> --zookeeper <zk>:2181/kafka
>
> Seems fine, can send/receive, etc..
>
> Kill 27, start 28. Try to reassign the single partition topic with the
> following json.
>
> Contains an error. partition should be 0 not 1.
>
> {"partitions":
> [{"topic": "first-cluster-topic", "partition": 1, "replicas": [25,26,28]
> }]
> }
>
> ./bin/kafka-reassign-partitions.sh --zookeeper ... -path-to-json-file
> reassign.json
>
> 2013-03-21 12:14:46,170] INFO zookeeper state changed (SyncConnected)
> (org.I0Itec.zkclient.ZkClient)
> [2013-03-21 12:14:46,310] ERROR Skipping reassignment of partition
> [first-cluster-topic,1] since it doesn't exist
> (kafka.admin.ReassignPartitionsCommand)
> Successfully started reassignment of partitions
> Map([first-cluster-topic,1] -> List(25, 26, 28))
> [2013-03-21 12:14:46,665] INFO Terminate ZkClient event thread.
> (org.I0Itec.zkclient.ZkEventThread)
> [2013-03-21 12:14:46,780] INFO Session: 0x13d8a63a3760007 closed
> (org.apache.zookeeper.ZooKeeper)
> [2013-03-21 12:14:46,780] INFO EventThread shut down
> (org.apache.zookeeper.ClientCnxn)
>
> Ok, fix the JSON
>
> {"partitions":
> [{"topic": "first-cluster-topic", "partition": 0, "replicas": [25,26,28]
> }]
> }
>
> ./bin/kafka-reassign-partitions.sh --zookeeper ... -path-to-json-file
> reassign.json
>
>
> [2013-03-21 12:17:34,367] INFO zookeeper state changed (SyncConnected)
> (org.I0Itec.zkclient.ZkClient)
> Partitions reassignment failed due to Partition reassignment currently in
> progress for Map(). Aborting operation
> kafka.common.AdminCommandFailedException: Partition reassignment currently
> in progress for Map(). Aborting operation
> at
> kafka.admin.ReassignPartitionsCommand.reassignPartitions(ReassignPartitionsCommand.scala:91)
> at
> kafka.admin.ReassignPartitionsCommand$.main(ReassignPartitionsCommand.scala:65)
> at
> kafka.admin.ReassignPartitionsCommand.main(ReassignPartitionsCommand.scala)
>
> ./bin/kafka-check-reassignment-status.sh --zookeeper ...
> --path-to-json-file reassign.json
>
>
> [2013-03-21 12:20:40,607] INFO zookeeper state changed (SyncConnected)
> (org.I0Itec.zkclient.ZkClient)
> Exception in thread "main" java.lang.ClassCastException:
> scala.collection.immutable.Map$Map1 cannot be cast to
> [Lscala.collection.Map;
> at
> kafka.admin.CheckReassignmentStatus$.main(CheckReassignmentStatus.scala:44)
> at kafka.admin.CheckReassignmentStatus.main(CheckReassignmentStatus.scala)
>
>
>
>
>