You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@kafka.apache.org by "Xavier Léauté (JIRA)" <ji...@apache.org> on 2017/05/05 23:02:04 UTC

[jira] [Updated] (KAFKA-5183) Transient failure: ReassignPartitionsClusterTest.shouldChangeThrottleOnRerunAndRemoveOnVerify

     [ https://issues.apache.org/jira/browse/KAFKA-5183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Xavier Léauté updated KAFKA-5183:
---------------------------------
    Description: 
https://builds.apache.org/job/kafka-pr-jdk8-scala2.11/3577/testReport/junit/kafka.admin/ReassignPartitionsClusterTest/shouldChangeThrottleOnRerunAndRemoveOnVerify/

*Error Message*
{code}
java.lang.AssertionError: throttle limit/replicas was not set
{code}

*Stacktrace*
{code}
java.lang.AssertionError: throttle limit/replicas was not set
	at kafka.utils.TestUtils$.fail(TestUtils.scala:311)
	at kafka.utils.TestUtils$.waitUntilTrue(TestUtils.scala:811)
	at kafka.admin.ReplicationQuotaUtils$.checkThrottleConfigAddedToZK(ReplicationQuotaUtils.scala:38)
	at kafka.admin.ReassignPartitionsClusterTest.shouldChangeThrottleOnRerunAndRemoveOnVerify(ReassignPartitionsClusterTest.scala:266)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50)
	at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
	at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47)
	at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
	at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
	at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
	at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325)
	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78)
	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57)
	at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290)
	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71)
	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288)
	at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58)
	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268)
	at org.junit.runners.ParentRunner.run(ParentRunner.java:363)
	at org.gradle.api.internal.tasks.testing.junit.JUnitTestClassExecuter.runTestClass(JUnitTestClassExecuter.java:114)
	at org.gradle.api.internal.tasks.testing.junit.JUnitTestClassExecuter.execute(JUnitTestClassExecuter.java:57)
	at org.gradle.api.internal.tasks.testing.junit.JUnitTestClassProcessor.processTestClass(JUnitTestClassProcessor.java:66)
	at org.gradle.api.internal.tasks.testing.SuiteTestClassProcessor.processTestClass(SuiteTestClassProcessor.java:51)
	at sun.reflect.GeneratedMethodAccessor3.invoke(Unknown Source)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at org.gradle.internal.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:35)
	at org.gradle.internal.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:24)
	at org.gradle.internal.dispatch.ContextClassLoaderDispatch.dispatch(ContextClassLoaderDispatch.java:32)
	at org.gradle.internal.dispatch.ProxyDispatchAdapter$DispatchingInvocationHandler.invoke(ProxyDispatchAdapter.java:93)
	at com.sun.proxy.$Proxy2.processTestClass(Unknown Source)
	at org.gradle.api.internal.tasks.testing.worker.TestWorker.processTestClass(TestWorker.java:109)
	at sun.reflect.GeneratedMethodAccessor2.invoke(Unknown Source)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at org.gradle.internal.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:35)
	at org.gradle.internal.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:24)
	at org.gradle.internal.remote.internal.hub.MessageHubBackedObjectConnection$DispatchWrapper.dispatch(MessageHubBackedObjectConnection.java:147)
	at org.gradle.internal.remote.internal.hub.MessageHubBackedObjectConnection$DispatchWrapper.dispatch(MessageHubBackedObjectConnection.java:129)
	at org.gradle.internal.remote.internal.hub.MessageHub$Handler.run(MessageHub.java:404)
	at org.gradle.internal.concurrent.ExecutorPolicy$CatchAndRecordFailures.onExecute(ExecutorPolicy.java:63)
	at org.gradle.internal.concurrent.StoppableExecutorImpl$1.run(StoppableExecutorImpl.java:46)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
	at java.lang.Thread.run(Thread.java:745)
{code}

*Standard Output*
{code}
[2017-05-05 22:23:53,206] ERROR ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes (org.apache.zookeeper.server.ZooKeeperServer:472)
Current partition replica assignment

{"version":1,"partitions":[{"topic":"my-topic","partition":0,"replicas":[100,101]}]}

Save this to use as the --reassignment-json-file option during rollback
Warning: You must run Verify periodically, until the reassignment completes, to ensure the throttle is removed. You can also alter the throttle by rerunning the Execute command passing a new value.
The throttle limit was set to 10000000 B/s
Successfully started reassignment of partitions.
[2017-05-05 22:24:03,427] ERROR ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes (org.apache.zookeeper.server.ZooKeeperServer:472)
[2017-05-05 22:24:03,483] ERROR ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes (org.apache.zookeeper.server.ZooKeeperServer:472)
[2017-05-05 22:24:05,122] ERROR ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes (org.apache.zookeeper.server.ZooKeeperServer:472)
[2017-05-05 22:24:05,138] ERROR ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes (org.apache.zookeeper.server.ZooKeeperServer:472)
[2017-05-05 22:24:06,185] ERROR [ReplicaFetcherThread-0-104]: Error for partition [topic2,1] to broker 104:org.apache.kafka.common.errors.UnknownTopicOrPartitionException: This server does not host this topic-partition. (kafka.server.ReplicaFetcherThread:99)
Current partition replica assignment

{"version":1,"partitions":[{"topic":"topic2","partition":1,"replicas":[104,105]},{"topic":"topic2","partition":0,"replicas":[104,105]},{"topic":"topic1","partition":1,"replicas":[100,101]},{"topic":"topic1","partition":2,"replicas":[103,104]},{"topic":"topic1","partition":0,"replicas":[100,101]},{"topic":"topic2","partition":2,"replicas":[103,104]}]}

Save this to use as the --reassignment-json-file option during rollback
Warning: You must run Verify periodically, until the reassignment completes, to ensure the throttle is removed. You can also alter the throttle by rerunning the Execute command passing a new value.
The throttle limit was set to 1000000 B/s
Successfully started reassignment of partitions.
[2017-05-05 22:24:07,067] ERROR [Controller 100]: Error completing reassignment of partition [topic2,2] (kafka.controller.KafkaController:105)
kafka.common.KafkaException: Partition [topic2,2] to be reassigned is already assigned to replicas 103,104. Ignoring request for partition reassignment
	at kafka.controller.KafkaController.initiateReassignReplicasForTopicPartition(KafkaController.scala:553)
	at kafka.controller.KafkaController$PartitionReassignment$$anonfun$process$16.apply(KafkaController.scala:1274)
	at kafka.controller.KafkaController$PartitionReassignment$$anonfun$process$16.apply(KafkaController.scala:1267)
	at scala.collection.immutable.HashMap$HashMap1.foreach(HashMap.scala:221)
	at scala.collection.immutable.HashMap$HashTrieMap.foreach(HashMap.scala:428)
	at kafka.controller.KafkaController$PartitionReassignment.process(KafkaController.scala:1267)
	at kafka.controller.KafkaController$ControllerEventThread.doWork(KafkaController.scala:1147)
	at kafka.utils.ShutdownableThread.run(ShutdownableThread.scala:64)
[2017-05-05 22:24:07,143] ERROR [Controller 100]: Error completing reassignment of partition [topic1,2] (kafka.controller.KafkaController:105)
kafka.common.KafkaException: Partition [topic1,2] to be reassigned is already assigned to replicas 103,104. Ignoring request for partition reassignment
	at kafka.controller.KafkaController.initiateReassignReplicasForTopicPartition(KafkaController.scala:553)
	at kafka.controller.KafkaController$PartitionReassignment$$anonfun$process$16.apply(KafkaController.scala:1274)
	at kafka.controller.KafkaController$PartitionReassignment$$anonfun$process$16.apply(KafkaController.scala:1267)
	at scala.collection.immutable.HashMap$HashMap1.foreach(HashMap.scala:221)
	at scala.collection.immutable.HashMap$HashTrieMap.foreach(HashMap.scala:428)
	at scala.collection.immutable.HashMap$HashTrieMap.foreach(HashMap.scala:428)
	at kafka.controller.KafkaController$PartitionReassignment.process(KafkaController.scala:1267)
	at kafka.controller.KafkaController$ControllerEventThread.doWork(KafkaController.scala:1147)
	at kafka.utils.ShutdownableThread.run(ShutdownableThread.scala:64)
[2017-05-05 22:24:07,255] ERROR [Controller 100]: Error completing reassignment of partition [topic1,2] (kafka.controller.KafkaController:105)
kafka.common.KafkaException: Partition [topic1,2] to be reassigned is already assigned to replicas 103,104. Ignoring request for partition reassignment
	at kafka.controller.KafkaController.initiateReassignReplicasForTopicPartition(KafkaController.scala:553)
	at kafka.controller.KafkaController$PartitionReassignment$$anonfun$process$16.apply(KafkaController.scala:1274)
	at kafka.controller.KafkaController$PartitionReassignment$$anonfun$process$16.apply(KafkaController.scala:1267)
	at scala.collection.immutable.HashMap$HashMap1.foreach(HashMap.scala:221)
	at kafka.controller.KafkaController$PartitionReassignment.process(KafkaController.scala:1267)
	at kafka.controller.KafkaController$ControllerEventThread.doWork(KafkaController.scala:1147)
	at kafka.utils.ShutdownableThread.run(ShutdownableThread.scala:64)
[2017-05-05 22:24:10,139] WARN caught end of stream exception (org.apache.zookeeper.server.NIOServerCnxn:368)
EndOfStreamException: Unable to read additional data from client sessionid 0x15bdab6800b0003, likely client has closed socket
	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
	at java.lang.Thread.run(Thread.java:745)
[2017-05-05 22:24:11,420] ERROR ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes (org.apache.zookeeper.server.ZooKeeperServer:472)
[2017-05-05 22:24:11,434] ERROR ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes (org.apache.zookeeper.server.ZooKeeperServer:472)
Current partition replica assignment

{"version":1,"partitions":[{"topic":"my-topic","partition":1,"replicas":[100,101]},{"topic":"my-topic","partition":0,"replicas":[100,101]},{"topic":"my-topic","partition":2,"replicas":[100,101]}]}

Save this to use as the --reassignment-json-file option during rollback
Successfully started reassignment of partitions.
[2017-05-05 22:24:12,271] ERROR [Controller 100]: Error completing reassignment of partition [my-topic,1] (kafka.controller.KafkaController:105)
kafka.common.KafkaException: Partition [my-topic,1] to be reassigned is already assigned to replicas 102,101. Ignoring request for partition reassignment
	at kafka.controller.KafkaController.initiateReassignReplicasForTopicPartition(KafkaController.scala:553)
	at kafka.controller.KafkaController$PartitionReassignment$$anonfun$process$16.apply(KafkaController.scala:1274)
	at kafka.controller.KafkaController$PartitionReassignment$$anonfun$process$16.apply(KafkaController.scala:1267)
	at scala.collection.immutable.Map$Map1.foreach(Map.scala:116)
	at kafka.controller.KafkaController$PartitionReassignment.process(KafkaController.scala:1267)
	at kafka.controller.KafkaController$ControllerEventThread.doWork(KafkaController.scala:1147)
	at kafka.utils.ShutdownableThread.run(ShutdownableThread.scala:64)
[2017-05-05 22:24:16,144] ERROR ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes (org.apache.zookeeper.server.ZooKeeperServer:472)
[2017-05-05 22:24:16,157] ERROR ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes (org.apache.zookeeper.server.ZooKeeperServer:472)
[2017-05-05 22:24:18,698] ERROR ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes (org.apache.zookeeper.server.ZooKeeperServer:472)
[2017-05-05 22:24:18,708] ERROR ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes (org.apache.zookeeper.server.ZooKeeperServer:472)
[2017-05-05 22:24:20,312] ERROR ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes (org.apache.zookeeper.server.ZooKeeperServer:472)
[2017-05-05 22:24:20,323] ERROR ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes (org.apache.zookeeper.server.ZooKeeperServer:472)
Current partition replica assignment

{"version":1,"partitions":[{"topic":"my-topic","partition":0,"replicas":[100]}]}

Save this to use as the --reassignment-json-file option during rollback
Successfully started reassignment of partitions.
[2017-05-05 22:24:21,782] ERROR ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes (org.apache.zookeeper.server.ZooKeeperServer:472)
[2017-05-05 22:24:21,797] ERROR ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes (org.apache.zookeeper.server.ZooKeeperServer:472)
[2017-05-05 22:24:22,037] ERROR [ReplicaFetcherThread-0-102]: Error for partition [my-topic,2] to broker 102:org.apache.kafka.common.errors.UnknownTopicOrPartitionException: This server does not host this topic-partition. (kafka.server.ReplicaFetcherThread:99)
Current partition replica assignment

{"version":1,"partitions":[{"topic":"my-topic","partition":1,"replicas":[101,102]},{"topic":"my-topic","partition":0,"replicas":[100,101]},{"topic":"my-topic","partition":2,"replicas":[102,100]}]}

Save this to use as the --reassignment-json-file option during rollback
Successfully started reassignment of partitions.
[2017-05-05 22:24:22,472] ERROR [Controller 100]: Error completing reassignment of partition [my-topic,0] (kafka.controller.KafkaController:105)
kafka.common.KafkaException: Partition [my-topic,0] to be reassigned is already assigned to replicas 100,101. Ignoring request for partition reassignment
	at kafka.controller.KafkaController.initiateReassignReplicasForTopicPartition(KafkaController.scala:553)
	at kafka.controller.KafkaController$PartitionReassignment$$anonfun$process$16.apply(KafkaController.scala:1274)
	at kafka.controller.KafkaController$PartitionReassignment$$anonfun$process$16.apply(KafkaController.scala:1267)
	at scala.collection.immutable.Map$Map3.foreach(Map.scala:161)
	at kafka.controller.KafkaController$PartitionReassignment.process(KafkaController.scala:1267)
	at kafka.controller.KafkaController$ControllerEventThread.doWork(KafkaController.scala:1147)
	at kafka.utils.ShutdownableThread.run(ShutdownableThread.scala:64)
[2017-05-05 22:24:22,531] ERROR [Controller 100]: Error completing reassignment of partition [my-topic,1] (kafka.controller.KafkaController:105)
kafka.common.KafkaException: Partition [my-topic,1] to be reassigned is already assigned to replicas 101,100. Ignoring request for partition reassignment
	at kafka.controller.KafkaController.initiateReassignReplicasForTopicPartition(KafkaController.scala:553)
	at kafka.controller.KafkaController$PartitionReassignment$$anonfun$process$16.apply(KafkaController.scala:1274)
	at kafka.controller.KafkaController$PartitionReassignment$$anonfun$process$16.apply(KafkaController.scala:1267)
	at scala.collection.immutable.Map$Map1.foreach(Map.scala:116)
	at kafka.controller.KafkaController$PartitionReassignment.process(KafkaController.scala:1267)
	at kafka.controller.KafkaController$ControllerEventThread.doWork(KafkaController.scala:1147)
	at kafka.utils.ShutdownableThread.run(ShutdownableThread.scala:64)
[2017-05-05 22:24:22,587] ERROR [Controller 100]: Error completing reassignment of partition [my-topic,2] (kafka.controller.KafkaController:105)
kafka.common.KafkaException: Partition [my-topic,2] to be reassigned is already assigned to replicas 100,101. Ignoring request for partition reassignment
	at kafka.controller.KafkaController.initiateReassignReplicasForTopicPartition(KafkaController.scala:553)
	at kafka.controller.KafkaController$PartitionReassignment$$anonfun$process$16.apply(KafkaController.scala:1274)
	at kafka.controller.KafkaController$PartitionReassignment$$anonfun$process$16.apply(KafkaController.scala:1267)
	at scala.collection.immutable.Map$Map1.foreach(Map.scala:116)
	at kafka.controller.KafkaController$PartitionReassignment.process(KafkaController.scala:1267)
	at kafka.controller.KafkaController$ControllerEventThread.doWork(KafkaController.scala:1147)
	at kafka.utils.ShutdownableThread.run(ShutdownableThread.scala:64)
[2017-05-05 22:24:22,589] ERROR [Controller 100]: Error completing reassignment of partition [my-topic,2] (kafka.controller.KafkaController:105)
kafka.common.KafkaException: Partition [my-topic,2] to be reassigned is already assigned to replicas 100,101. Ignoring request for partition reassignment
	at kafka.controller.KafkaController.initiateReassignReplicasForTopicPartition(KafkaController.scala:553)
	at kafka.controller.KafkaController$PartitionReassignment$$anonfun$process$16.apply(KafkaController.scala:1274)
	at kafka.controller.KafkaController$PartitionReassignment$$anonfun$process$16.apply(KafkaController.scala:1267)
	at scala.collection.immutable.Map$Map1.foreach(Map.scala:116)
	at kafka.controller.KafkaController$PartitionReassignment.process(KafkaController.scala:1267)
	at kafka.controller.KafkaController$ControllerEventThread.doWork(KafkaController.scala:1147)
	at kafka.utils.ShutdownableThread.run(ShutdownableThread.scala:64)
[2017-05-05 22:24:25,282] ERROR ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes (org.apache.zookeeper.server.ZooKeeperServer:472)
[2017-05-05 22:24:25,294] ERROR ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes (org.apache.zookeeper.server.ZooKeeperServer:472)
The throttle limit was set to 1000 B/s
[2017-05-05 22:24:27,545] ERROR [Controller 0]: Error completing reassignment of partition [orders,1] (kafka.controller.KafkaController:105)
kafka.common.KafkaException: Partition [orders,1] to be reassigned is already assigned to replicas 0,1,2. Ignoring request for partition reassignment
	at kafka.controller.KafkaController.initiateReassignReplicasForTopicPartition(KafkaController.scala:553)
	at kafka.controller.KafkaController$PartitionReassignment$$anonfun$process$16.apply(KafkaController.scala:1274)
	at kafka.controller.KafkaController$PartitionReassignment$$anonfun$process$16.apply(KafkaController.scala:1267)
	at scala.collection.immutable.Map$Map4.foreach(Map.scala:188)
	at kafka.controller.KafkaController$PartitionReassignment.process(KafkaController.scala:1267)
	at kafka.controller.KafkaController$ControllerEventThread.doWork(KafkaController.scala:1147)
	at kafka.utils.ShutdownableThread.run(ShutdownableThread.scala:64)
[2017-05-05 22:24:27,637] ERROR [Controller 0]: Error completing reassignment of partition [orders,0] (kafka.controller.KafkaController:105)
kafka.common.KafkaException: Partition [orders,0] to be reassigned is already assigned to replicas 0,2,3. Ignoring request for partition reassignment
	at kafka.controller.KafkaController.initiateReassignReplicasForTopicPartition(KafkaController.scala:553)
	at kafka.controller.KafkaController$PartitionReassignment$$anonfun$process$16.apply(KafkaController.scala:1274)
	at kafka.controller.KafkaController$PartitionReassignment$$anonfun$process$16.apply(KafkaController.scala:1267)
	at scala.collection.immutable.Map$Map1.foreach(Map.scala:116)
	at kafka.controller.KafkaController$PartitionReassignment.process(KafkaController.scala:1267)
	at kafka.controller.KafkaController$ControllerEventThread.doWork(KafkaController.scala:1147)
	at kafka.utils.ShutdownableThread.run(ShutdownableThread.scala:64)
[2017-05-05 22:24:28,114] ERROR [Controller 0]: Error completing reassignment of partition [deliveries,0] (kafka.controller.KafkaController:105)
kafka.common.KafkaException: Partition [deliveries,0] to be reassigned is already assigned to replicas 1,2. Ignoring request for partition reassignment
	at kafka.controller.KafkaController.initiateReassignReplicasForTopicPartition(KafkaController.scala:553)
	at kafka.controller.KafkaController$PartitionReassignment$$anonfun$process$16.apply(KafkaController.scala:1274)
	at kafka.controller.KafkaController$PartitionReassignment$$anonfun$process$16.apply(KafkaController.scala:1267)
	at scala.collection.immutable.Map$Map1.foreach(Map.scala:116)
	at kafka.controller.KafkaController$PartitionReassignment.process(KafkaController.scala:1267)
	at kafka.controller.KafkaController$ControllerEventThread.doWork(KafkaController.scala:1147)
	at kafka.utils.ShutdownableThread.run(ShutdownableThread.scala:64)
[2017-05-05 22:24:31,022] ERROR ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes (org.apache.zookeeper.server.ZooKeeperServer:472)
[2017-05-05 22:24:31,040] ERROR ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes (org.apache.zookeeper.server.ZooKeeperServer:472)
Current partition replica assignment

{"version":1,"partitions":[{"topic":"my-topic","partition":0,"replicas":[100,101]}]}

Save this to use as the --reassignment-json-file option during rollback
Warning: You must run Verify periodically, until the reassignment completes, to ensure the throttle is removed. You can also alter the throttle by rerunning the Execute command passing a new value.
The throttle limit was set to 1000000 B/s
Successfully started reassignment of partitions.
Status of partition reassignment: 
Reassignment of partition [my-topic,0] is still in progress
There is an existing assignment running.
[2017-05-05 22:24:50,684] ERROR ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes (org.apache.zookeeper.server.ZooKeeperServer:472)
[2017-05-05 22:24:50,734] ERROR ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes (org.apache.zookeeper.server.ZooKeeperServer:472)
Current partition replica assignment

{"version":1,"partitions":[{"topic":"topic2","partition":1,"replicas":[101,102]},{"topic":"topic2","partition":0,"replicas":[100,101]},{"topic":"topic1","partition":1,"replicas":[101,102]},{"topic":"topic1","partition":2,"replicas":[102,100]},{"topic":"topic1","partition":0,"replicas":[100,101]},{"topic":"topic2","partition":2,"replicas":[102,100]}]}

Save this to use as the --reassignment-json-file option during rollback
Successfully started reassignment of partitions.
[2017-05-05 22:24:51,982] ERROR [Controller 100]: Error completing reassignment of partition [topic1,0] (kafka.controller.KafkaController:105)
kafka.common.KafkaException: Partition [topic1,0] to be reassigned is already assigned to replicas 100,102. Ignoring request for partition reassignment
	at kafka.controller.KafkaController.initiateReassignReplicasForTopicPartition(KafkaController.scala:553)
	at kafka.controller.KafkaController$PartitionReassignment$$anonfun$process$16.apply(KafkaController.scala:1274)
	at kafka.controller.KafkaController$PartitionReassignment$$anonfun$process$16.apply(KafkaController.scala:1267)
	at scala.collection.immutable.Map$Map2.foreach(Map.scala:137)
	at kafka.controller.KafkaController$PartitionReassignment.process(KafkaController.scala:1267)
	at kafka.controller.KafkaController$ControllerEventThread.doWork(KafkaController.scala:1147)
	at kafka.utils.ShutdownableThread.run(ShutdownableThread.scala:64)
[2017-05-05 22:24:51,989] ERROR [Controller 100]: Error completing reassignment of partition [topic2,2] (kafka.controller.KafkaController:105)
kafka.common.KafkaException: Partition [topic2,2] to be reassigned is already assigned to replicas 100,102. Ignoring request for partition reassignment
	at kafka.controller.KafkaController.initiateReassignReplicasForTopicPartition(KafkaController.scala:553)
	at kafka.controller.KafkaController$PartitionReassignment$$anonfun$process$16.apply(KafkaController.scala:1274)
	at kafka.controller.KafkaController$PartitionReassignment$$anonfun$process$16.apply(KafkaController.scala:1267)
	at scala.collection.immutable.Map$Map2.foreach(Map.scala:137)
	at kafka.controller.KafkaController$PartitionReassignment.process(KafkaController.scala:1267)
	at kafka.controller.KafkaController$ControllerEventThread.doWork(KafkaController.scala:1147)
	at kafka.utils.ShutdownableThread.run(ShutdownableThread.scala:64)
[2017-05-05 22:24:51,993] ERROR [Controller 100]: Error completing reassignment of partition [topic1,0] (kafka.controller.KafkaController:105)
kafka.common.KafkaException: Partition [topic1,0] to be reassigned is already assigned to replicas 100,102. Ignoring request for partition reassignment
	at kafka.controller.KafkaController.initiateReassignReplicasForTopicPartition(KafkaController.scala:553)
	at kafka.controller.KafkaController$PartitionReassignment$$anonfun$process$16.apply(KafkaController.scala:1274)
	at kafka.controller.KafkaController$PartitionReassignment$$anonfun$process$16.apply(KafkaController.scala:1267)
	at scala.collection.immutable.Map$Map1.foreach(Map.scala:116)
	at kafka.controller.KafkaController$PartitionReassignment.process(KafkaController.scala:1267)
	at kafka.controller.KafkaController$ControllerEventThread.doWork(KafkaController.scala:1147)
	at kafka.utils.ShutdownableThread.run(ShutdownableThread.scala:64)
[2017-05-05 22:24:54,342] ERROR ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes (org.apache.zookeeper.server.ZooKeeperServer:472)
{code}

  was:
https://builds.apache.org/job/kafka-pr-jdk8-scala2.11/3577/testReport/junit/kafka.admin/ReassignPartitionsClusterTest/shouldChangeThrottleOnRerunAndRemoveOnVerify/

*Error Message*
{code}
java.lang.AssertionError: throttle limit/replicas was not set
{code}

Stacktrace
{code}
java.lang.AssertionError: throttle limit/replicas was not set
	at kafka.utils.TestUtils$.fail(TestUtils.scala:311)
	at kafka.utils.TestUtils$.waitUntilTrue(TestUtils.scala:811)
	at kafka.admin.ReplicationQuotaUtils$.checkThrottleConfigAddedToZK(ReplicationQuotaUtils.scala:38)
	at kafka.admin.ReassignPartitionsClusterTest.shouldChangeThrottleOnRerunAndRemoveOnVerify(ReassignPartitionsClusterTest.scala:266)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50)
	at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
	at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47)
	at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
	at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
	at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
	at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325)
	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78)
	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57)
	at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290)
	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71)
	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288)
	at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58)
	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268)
	at org.junit.runners.ParentRunner.run(ParentRunner.java:363)
	at org.gradle.api.internal.tasks.testing.junit.JUnitTestClassExecuter.runTestClass(JUnitTestClassExecuter.java:114)
	at org.gradle.api.internal.tasks.testing.junit.JUnitTestClassExecuter.execute(JUnitTestClassExecuter.java:57)
	at org.gradle.api.internal.tasks.testing.junit.JUnitTestClassProcessor.processTestClass(JUnitTestClassProcessor.java:66)
	at org.gradle.api.internal.tasks.testing.SuiteTestClassProcessor.processTestClass(SuiteTestClassProcessor.java:51)
	at sun.reflect.GeneratedMethodAccessor3.invoke(Unknown Source)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at org.gradle.internal.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:35)
	at org.gradle.internal.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:24)
	at org.gradle.internal.dispatch.ContextClassLoaderDispatch.dispatch(ContextClassLoaderDispatch.java:32)
	at org.gradle.internal.dispatch.ProxyDispatchAdapter$DispatchingInvocationHandler.invoke(ProxyDispatchAdapter.java:93)
	at com.sun.proxy.$Proxy2.processTestClass(Unknown Source)
	at org.gradle.api.internal.tasks.testing.worker.TestWorker.processTestClass(TestWorker.java:109)
	at sun.reflect.GeneratedMethodAccessor2.invoke(Unknown Source)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at org.gradle.internal.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:35)
	at org.gradle.internal.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:24)
	at org.gradle.internal.remote.internal.hub.MessageHubBackedObjectConnection$DispatchWrapper.dispatch(MessageHubBackedObjectConnection.java:147)
	at org.gradle.internal.remote.internal.hub.MessageHubBackedObjectConnection$DispatchWrapper.dispatch(MessageHubBackedObjectConnection.java:129)
	at org.gradle.internal.remote.internal.hub.MessageHub$Handler.run(MessageHub.java:404)
	at org.gradle.internal.concurrent.ExecutorPolicy$CatchAndRecordFailures.onExecute(ExecutorPolicy.java:63)
	at org.gradle.internal.concurrent.StoppableExecutorImpl$1.run(StoppableExecutorImpl.java:46)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
	at java.lang.Thread.run(Thread.java:745)
{code}

*Standard Output*
{code}
[2017-05-05 22:23:53,206] ERROR ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes (org.apache.zookeeper.server.ZooKeeperServer:472)
Current partition replica assignment

{"version":1,"partitions":[{"topic":"my-topic","partition":0,"replicas":[100,101]}]}

Save this to use as the --reassignment-json-file option during rollback
Warning: You must run Verify periodically, until the reassignment completes, to ensure the throttle is removed. You can also alter the throttle by rerunning the Execute command passing a new value.
The throttle limit was set to 10000000 B/s
Successfully started reassignment of partitions.
[2017-05-05 22:24:03,427] ERROR ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes (org.apache.zookeeper.server.ZooKeeperServer:472)
[2017-05-05 22:24:03,483] ERROR ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes (org.apache.zookeeper.server.ZooKeeperServer:472)
[2017-05-05 22:24:05,122] ERROR ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes (org.apache.zookeeper.server.ZooKeeperServer:472)
[2017-05-05 22:24:05,138] ERROR ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes (org.apache.zookeeper.server.ZooKeeperServer:472)
[2017-05-05 22:24:06,185] ERROR [ReplicaFetcherThread-0-104]: Error for partition [topic2,1] to broker 104:org.apache.kafka.common.errors.UnknownTopicOrPartitionException: This server does not host this topic-partition. (kafka.server.ReplicaFetcherThread:99)
Current partition replica assignment

{"version":1,"partitions":[{"topic":"topic2","partition":1,"replicas":[104,105]},{"topic":"topic2","partition":0,"replicas":[104,105]},{"topic":"topic1","partition":1,"replicas":[100,101]},{"topic":"topic1","partition":2,"replicas":[103,104]},{"topic":"topic1","partition":0,"replicas":[100,101]},{"topic":"topic2","partition":2,"replicas":[103,104]}]}

Save this to use as the --reassignment-json-file option during rollback
Warning: You must run Verify periodically, until the reassignment completes, to ensure the throttle is removed. You can also alter the throttle by rerunning the Execute command passing a new value.
The throttle limit was set to 1000000 B/s
Successfully started reassignment of partitions.
[2017-05-05 22:24:07,067] ERROR [Controller 100]: Error completing reassignment of partition [topic2,2] (kafka.controller.KafkaController:105)
kafka.common.KafkaException: Partition [topic2,2] to be reassigned is already assigned to replicas 103,104. Ignoring request for partition reassignment
	at kafka.controller.KafkaController.initiateReassignReplicasForTopicPartition(KafkaController.scala:553)
	at kafka.controller.KafkaController$PartitionReassignment$$anonfun$process$16.apply(KafkaController.scala:1274)
	at kafka.controller.KafkaController$PartitionReassignment$$anonfun$process$16.apply(KafkaController.scala:1267)
	at scala.collection.immutable.HashMap$HashMap1.foreach(HashMap.scala:221)
	at scala.collection.immutable.HashMap$HashTrieMap.foreach(HashMap.scala:428)
	at kafka.controller.KafkaController$PartitionReassignment.process(KafkaController.scala:1267)
	at kafka.controller.KafkaController$ControllerEventThread.doWork(KafkaController.scala:1147)
	at kafka.utils.ShutdownableThread.run(ShutdownableThread.scala:64)
[2017-05-05 22:24:07,143] ERROR [Controller 100]: Error completing reassignment of partition [topic1,2] (kafka.controller.KafkaController:105)
kafka.common.KafkaException: Partition [topic1,2] to be reassigned is already assigned to replicas 103,104. Ignoring request for partition reassignment
	at kafka.controller.KafkaController.initiateReassignReplicasForTopicPartition(KafkaController.scala:553)
	at kafka.controller.KafkaController$PartitionReassignment$$anonfun$process$16.apply(KafkaController.scala:1274)
	at kafka.controller.KafkaController$PartitionReassignment$$anonfun$process$16.apply(KafkaController.scala:1267)
	at scala.collection.immutable.HashMap$HashMap1.foreach(HashMap.scala:221)
	at scala.collection.immutable.HashMap$HashTrieMap.foreach(HashMap.scala:428)
	at scala.collection.immutable.HashMap$HashTrieMap.foreach(HashMap.scala:428)
	at kafka.controller.KafkaController$PartitionReassignment.process(KafkaController.scala:1267)
	at kafka.controller.KafkaController$ControllerEventThread.doWork(KafkaController.scala:1147)
	at kafka.utils.ShutdownableThread.run(ShutdownableThread.scala:64)
[2017-05-05 22:24:07,255] ERROR [Controller 100]: Error completing reassignment of partition [topic1,2] (kafka.controller.KafkaController:105)
kafka.common.KafkaException: Partition [topic1,2] to be reassigned is already assigned to replicas 103,104. Ignoring request for partition reassignment
	at kafka.controller.KafkaController.initiateReassignReplicasForTopicPartition(KafkaController.scala:553)
	at kafka.controller.KafkaController$PartitionReassignment$$anonfun$process$16.apply(KafkaController.scala:1274)
	at kafka.controller.KafkaController$PartitionReassignment$$anonfun$process$16.apply(KafkaController.scala:1267)
	at scala.collection.immutable.HashMap$HashMap1.foreach(HashMap.scala:221)
	at kafka.controller.KafkaController$PartitionReassignment.process(KafkaController.scala:1267)
	at kafka.controller.KafkaController$ControllerEventThread.doWork(KafkaController.scala:1147)
	at kafka.utils.ShutdownableThread.run(ShutdownableThread.scala:64)
[2017-05-05 22:24:10,139] WARN caught end of stream exception (org.apache.zookeeper.server.NIOServerCnxn:368)
EndOfStreamException: Unable to read additional data from client sessionid 0x15bdab6800b0003, likely client has closed socket
	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
	at java.lang.Thread.run(Thread.java:745)
[2017-05-05 22:24:11,420] ERROR ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes (org.apache.zookeeper.server.ZooKeeperServer:472)
[2017-05-05 22:24:11,434] ERROR ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes (org.apache.zookeeper.server.ZooKeeperServer:472)
Current partition replica assignment

{"version":1,"partitions":[{"topic":"my-topic","partition":1,"replicas":[100,101]},{"topic":"my-topic","partition":0,"replicas":[100,101]},{"topic":"my-topic","partition":2,"replicas":[100,101]}]}

Save this to use as the --reassignment-json-file option during rollback
Successfully started reassignment of partitions.
[2017-05-05 22:24:12,271] ERROR [Controller 100]: Error completing reassignment of partition [my-topic,1] (kafka.controller.KafkaController:105)
kafka.common.KafkaException: Partition [my-topic,1] to be reassigned is already assigned to replicas 102,101. Ignoring request for partition reassignment
	at kafka.controller.KafkaController.initiateReassignReplicasForTopicPartition(KafkaController.scala:553)
	at kafka.controller.KafkaController$PartitionReassignment$$anonfun$process$16.apply(KafkaController.scala:1274)
	at kafka.controller.KafkaController$PartitionReassignment$$anonfun$process$16.apply(KafkaController.scala:1267)
	at scala.collection.immutable.Map$Map1.foreach(Map.scala:116)
	at kafka.controller.KafkaController$PartitionReassignment.process(KafkaController.scala:1267)
	at kafka.controller.KafkaController$ControllerEventThread.doWork(KafkaController.scala:1147)
	at kafka.utils.ShutdownableThread.run(ShutdownableThread.scala:64)
[2017-05-05 22:24:16,144] ERROR ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes (org.apache.zookeeper.server.ZooKeeperServer:472)
[2017-05-05 22:24:16,157] ERROR ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes (org.apache.zookeeper.server.ZooKeeperServer:472)
[2017-05-05 22:24:18,698] ERROR ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes (org.apache.zookeeper.server.ZooKeeperServer:472)
[2017-05-05 22:24:18,708] ERROR ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes (org.apache.zookeeper.server.ZooKeeperServer:472)
[2017-05-05 22:24:20,312] ERROR ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes (org.apache.zookeeper.server.ZooKeeperServer:472)
[2017-05-05 22:24:20,323] ERROR ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes (org.apache.zookeeper.server.ZooKeeperServer:472)
Current partition replica assignment

{"version":1,"partitions":[{"topic":"my-topic","partition":0,"replicas":[100]}]}

Save this to use as the --reassignment-json-file option during rollback
Successfully started reassignment of partitions.
[2017-05-05 22:24:21,782] ERROR ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes (org.apache.zookeeper.server.ZooKeeperServer:472)
[2017-05-05 22:24:21,797] ERROR ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes (org.apache.zookeeper.server.ZooKeeperServer:472)
[2017-05-05 22:24:22,037] ERROR [ReplicaFetcherThread-0-102]: Error for partition [my-topic,2] to broker 102:org.apache.kafka.common.errors.UnknownTopicOrPartitionException: This server does not host this topic-partition. (kafka.server.ReplicaFetcherThread:99)
Current partition replica assignment

{"version":1,"partitions":[{"topic":"my-topic","partition":1,"replicas":[101,102]},{"topic":"my-topic","partition":0,"replicas":[100,101]},{"topic":"my-topic","partition":2,"replicas":[102,100]}]}

Save this to use as the --reassignment-json-file option during rollback
Successfully started reassignment of partitions.
[2017-05-05 22:24:22,472] ERROR [Controller 100]: Error completing reassignment of partition [my-topic,0] (kafka.controller.KafkaController:105)
kafka.common.KafkaException: Partition [my-topic,0] to be reassigned is already assigned to replicas 100,101. Ignoring request for partition reassignment
	at kafka.controller.KafkaController.initiateReassignReplicasForTopicPartition(KafkaController.scala:553)
	at kafka.controller.KafkaController$PartitionReassignment$$anonfun$process$16.apply(KafkaController.scala:1274)
	at kafka.controller.KafkaController$PartitionReassignment$$anonfun$process$16.apply(KafkaController.scala:1267)
	at scala.collection.immutable.Map$Map3.foreach(Map.scala:161)
	at kafka.controller.KafkaController$PartitionReassignment.process(KafkaController.scala:1267)
	at kafka.controller.KafkaController$ControllerEventThread.doWork(KafkaController.scala:1147)
	at kafka.utils.ShutdownableThread.run(ShutdownableThread.scala:64)
[2017-05-05 22:24:22,531] ERROR [Controller 100]: Error completing reassignment of partition [my-topic,1] (kafka.controller.KafkaController:105)
kafka.common.KafkaException: Partition [my-topic,1] to be reassigned is already assigned to replicas 101,100. Ignoring request for partition reassignment
	at kafka.controller.KafkaController.initiateReassignReplicasForTopicPartition(KafkaController.scala:553)
	at kafka.controller.KafkaController$PartitionReassignment$$anonfun$process$16.apply(KafkaController.scala:1274)
	at kafka.controller.KafkaController$PartitionReassignment$$anonfun$process$16.apply(KafkaController.scala:1267)
	at scala.collection.immutable.Map$Map1.foreach(Map.scala:116)
	at kafka.controller.KafkaController$PartitionReassignment.process(KafkaController.scala:1267)
	at kafka.controller.KafkaController$ControllerEventThread.doWork(KafkaController.scala:1147)
	at kafka.utils.ShutdownableThread.run(ShutdownableThread.scala:64)
[2017-05-05 22:24:22,587] ERROR [Controller 100]: Error completing reassignment of partition [my-topic,2] (kafka.controller.KafkaController:105)
kafka.common.KafkaException: Partition [my-topic,2] to be reassigned is already assigned to replicas 100,101. Ignoring request for partition reassignment
	at kafka.controller.KafkaController.initiateReassignReplicasForTopicPartition(KafkaController.scala:553)
	at kafka.controller.KafkaController$PartitionReassignment$$anonfun$process$16.apply(KafkaController.scala:1274)
	at kafka.controller.KafkaController$PartitionReassignment$$anonfun$process$16.apply(KafkaController.scala:1267)
	at scala.collection.immutable.Map$Map1.foreach(Map.scala:116)
	at kafka.controller.KafkaController$PartitionReassignment.process(KafkaController.scala:1267)
	at kafka.controller.KafkaController$ControllerEventThread.doWork(KafkaController.scala:1147)
	at kafka.utils.ShutdownableThread.run(ShutdownableThread.scala:64)
[2017-05-05 22:24:22,589] ERROR [Controller 100]: Error completing reassignment of partition [my-topic,2] (kafka.controller.KafkaController:105)
kafka.common.KafkaException: Partition [my-topic,2] to be reassigned is already assigned to replicas 100,101. Ignoring request for partition reassignment
	at kafka.controller.KafkaController.initiateReassignReplicasForTopicPartition(KafkaController.scala:553)
	at kafka.controller.KafkaController$PartitionReassignment$$anonfun$process$16.apply(KafkaController.scala:1274)
	at kafka.controller.KafkaController$PartitionReassignment$$anonfun$process$16.apply(KafkaController.scala:1267)
	at scala.collection.immutable.Map$Map1.foreach(Map.scala:116)
	at kafka.controller.KafkaController$PartitionReassignment.process(KafkaController.scala:1267)
	at kafka.controller.KafkaController$ControllerEventThread.doWork(KafkaController.scala:1147)
	at kafka.utils.ShutdownableThread.run(ShutdownableThread.scala:64)
[2017-05-05 22:24:25,282] ERROR ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes (org.apache.zookeeper.server.ZooKeeperServer:472)
[2017-05-05 22:24:25,294] ERROR ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes (org.apache.zookeeper.server.ZooKeeperServer:472)
The throttle limit was set to 1000 B/s
[2017-05-05 22:24:27,545] ERROR [Controller 0]: Error completing reassignment of partition [orders,1] (kafka.controller.KafkaController:105)
kafka.common.KafkaException: Partition [orders,1] to be reassigned is already assigned to replicas 0,1,2. Ignoring request for partition reassignment
	at kafka.controller.KafkaController.initiateReassignReplicasForTopicPartition(KafkaController.scala:553)
	at kafka.controller.KafkaController$PartitionReassignment$$anonfun$process$16.apply(KafkaController.scala:1274)
	at kafka.controller.KafkaController$PartitionReassignment$$anonfun$process$16.apply(KafkaController.scala:1267)
	at scala.collection.immutable.Map$Map4.foreach(Map.scala:188)
	at kafka.controller.KafkaController$PartitionReassignment.process(KafkaController.scala:1267)
	at kafka.controller.KafkaController$ControllerEventThread.doWork(KafkaController.scala:1147)
	at kafka.utils.ShutdownableThread.run(ShutdownableThread.scala:64)
[2017-05-05 22:24:27,637] ERROR [Controller 0]: Error completing reassignment of partition [orders,0] (kafka.controller.KafkaController:105)
kafka.common.KafkaException: Partition [orders,0] to be reassigned is already assigned to replicas 0,2,3. Ignoring request for partition reassignment
	at kafka.controller.KafkaController.initiateReassignReplicasForTopicPartition(KafkaController.scala:553)
	at kafka.controller.KafkaController$PartitionReassignment$$anonfun$process$16.apply(KafkaController.scala:1274)
	at kafka.controller.KafkaController$PartitionReassignment$$anonfun$process$16.apply(KafkaController.scala:1267)
	at scala.collection.immutable.Map$Map1.foreach(Map.scala:116)
	at kafka.controller.KafkaController$PartitionReassignment.process(KafkaController.scala:1267)
	at kafka.controller.KafkaController$ControllerEventThread.doWork(KafkaController.scala:1147)
	at kafka.utils.ShutdownableThread.run(ShutdownableThread.scala:64)
[2017-05-05 22:24:28,114] ERROR [Controller 0]: Error completing reassignment of partition [deliveries,0] (kafka.controller.KafkaController:105)
kafka.common.KafkaException: Partition [deliveries,0] to be reassigned is already assigned to replicas 1,2. Ignoring request for partition reassignment
	at kafka.controller.KafkaController.initiateReassignReplicasForTopicPartition(KafkaController.scala:553)
	at kafka.controller.KafkaController$PartitionReassignment$$anonfun$process$16.apply(KafkaController.scala:1274)
	at kafka.controller.KafkaController$PartitionReassignment$$anonfun$process$16.apply(KafkaController.scala:1267)
	at scala.collection.immutable.Map$Map1.foreach(Map.scala:116)
	at kafka.controller.KafkaController$PartitionReassignment.process(KafkaController.scala:1267)
	at kafka.controller.KafkaController$ControllerEventThread.doWork(KafkaController.scala:1147)
	at kafka.utils.ShutdownableThread.run(ShutdownableThread.scala:64)
[2017-05-05 22:24:31,022] ERROR ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes (org.apache.zookeeper.server.ZooKeeperServer:472)
[2017-05-05 22:24:31,040] ERROR ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes (org.apache.zookeeper.server.ZooKeeperServer:472)
Current partition replica assignment

{"version":1,"partitions":[{"topic":"my-topic","partition":0,"replicas":[100,101]}]}

Save this to use as the --reassignment-json-file option during rollback
Warning: You must run Verify periodically, until the reassignment completes, to ensure the throttle is removed. You can also alter the throttle by rerunning the Execute command passing a new value.
The throttle limit was set to 1000000 B/s
Successfully started reassignment of partitions.
Status of partition reassignment: 
Reassignment of partition [my-topic,0] is still in progress
There is an existing assignment running.
[2017-05-05 22:24:50,684] ERROR ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes (org.apache.zookeeper.server.ZooKeeperServer:472)
[2017-05-05 22:24:50,734] ERROR ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes (org.apache.zookeeper.server.ZooKeeperServer:472)
Current partition replica assignment

{"version":1,"partitions":[{"topic":"topic2","partition":1,"replicas":[101,102]},{"topic":"topic2","partition":0,"replicas":[100,101]},{"topic":"topic1","partition":1,"replicas":[101,102]},{"topic":"topic1","partition":2,"replicas":[102,100]},{"topic":"topic1","partition":0,"replicas":[100,101]},{"topic":"topic2","partition":2,"replicas":[102,100]}]}

Save this to use as the --reassignment-json-file option during rollback
Successfully started reassignment of partitions.
[2017-05-05 22:24:51,982] ERROR [Controller 100]: Error completing reassignment of partition [topic1,0] (kafka.controller.KafkaController:105)
kafka.common.KafkaException: Partition [topic1,0] to be reassigned is already assigned to replicas 100,102. Ignoring request for partition reassignment
	at kafka.controller.KafkaController.initiateReassignReplicasForTopicPartition(KafkaController.scala:553)
	at kafka.controller.KafkaController$PartitionReassignment$$anonfun$process$16.apply(KafkaController.scala:1274)
	at kafka.controller.KafkaController$PartitionReassignment$$anonfun$process$16.apply(KafkaController.scala:1267)
	at scala.collection.immutable.Map$Map2.foreach(Map.scala:137)
	at kafka.controller.KafkaController$PartitionReassignment.process(KafkaController.scala:1267)
	at kafka.controller.KafkaController$ControllerEventThread.doWork(KafkaController.scala:1147)
	at kafka.utils.ShutdownableThread.run(ShutdownableThread.scala:64)
[2017-05-05 22:24:51,989] ERROR [Controller 100]: Error completing reassignment of partition [topic2,2] (kafka.controller.KafkaController:105)
kafka.common.KafkaException: Partition [topic2,2] to be reassigned is already assigned to replicas 100,102. Ignoring request for partition reassignment
	at kafka.controller.KafkaController.initiateReassignReplicasForTopicPartition(KafkaController.scala:553)
	at kafka.controller.KafkaController$PartitionReassignment$$anonfun$process$16.apply(KafkaController.scala:1274)
	at kafka.controller.KafkaController$PartitionReassignment$$anonfun$process$16.apply(KafkaController.scala:1267)
	at scala.collection.immutable.Map$Map2.foreach(Map.scala:137)
	at kafka.controller.KafkaController$PartitionReassignment.process(KafkaController.scala:1267)
	at kafka.controller.KafkaController$ControllerEventThread.doWork(KafkaController.scala:1147)
	at kafka.utils.ShutdownableThread.run(ShutdownableThread.scala:64)
[2017-05-05 22:24:51,993] ERROR [Controller 100]: Error completing reassignment of partition [topic1,0] (kafka.controller.KafkaController:105)
kafka.common.KafkaException: Partition [topic1,0] to be reassigned is already assigned to replicas 100,102. Ignoring request for partition reassignment
	at kafka.controller.KafkaController.initiateReassignReplicasForTopicPartition(KafkaController.scala:553)
	at kafka.controller.KafkaController$PartitionReassignment$$anonfun$process$16.apply(KafkaController.scala:1274)
	at kafka.controller.KafkaController$PartitionReassignment$$anonfun$process$16.apply(KafkaController.scala:1267)
	at scala.collection.immutable.Map$Map1.foreach(Map.scala:116)
	at kafka.controller.KafkaController$PartitionReassignment.process(KafkaController.scala:1267)
	at kafka.controller.KafkaController$ControllerEventThread.doWork(KafkaController.scala:1147)
	at kafka.utils.ShutdownableThread.run(ShutdownableThread.scala:64)
[2017-05-05 22:24:54,342] ERROR ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes (org.apache.zookeeper.server.ZooKeeperServer:472)
{code}


> Transient failure: ReassignPartitionsClusterTest.shouldChangeThrottleOnRerunAndRemoveOnVerify
> ---------------------------------------------------------------------------------------------
>
>                 Key: KAFKA-5183
>                 URL: https://issues.apache.org/jira/browse/KAFKA-5183
>             Project: Kafka
>          Issue Type: Sub-task
>            Reporter: Xavier Léauté
>
> https://builds.apache.org/job/kafka-pr-jdk8-scala2.11/3577/testReport/junit/kafka.admin/ReassignPartitionsClusterTest/shouldChangeThrottleOnRerunAndRemoveOnVerify/
> *Error Message*
> {code}
> java.lang.AssertionError: throttle limit/replicas was not set
> {code}
> *Stacktrace*
> {code}
> java.lang.AssertionError: throttle limit/replicas was not set
> 	at kafka.utils.TestUtils$.fail(TestUtils.scala:311)
> 	at kafka.utils.TestUtils$.waitUntilTrue(TestUtils.scala:811)
> 	at kafka.admin.ReplicationQuotaUtils$.checkThrottleConfigAddedToZK(ReplicationQuotaUtils.scala:38)
> 	at kafka.admin.ReassignPartitionsClusterTest.shouldChangeThrottleOnRerunAndRemoveOnVerify(ReassignPartitionsClusterTest.scala:266)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> 	at java.lang.reflect.Method.invoke(Method.java:498)
> 	at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50)
> 	at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
> 	at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47)
> 	at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
> 	at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
> 	at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
> 	at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325)
> 	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78)
> 	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57)
> 	at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290)
> 	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71)
> 	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288)
> 	at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58)
> 	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268)
> 	at org.junit.runners.ParentRunner.run(ParentRunner.java:363)
> 	at org.gradle.api.internal.tasks.testing.junit.JUnitTestClassExecuter.runTestClass(JUnitTestClassExecuter.java:114)
> 	at org.gradle.api.internal.tasks.testing.junit.JUnitTestClassExecuter.execute(JUnitTestClassExecuter.java:57)
> 	at org.gradle.api.internal.tasks.testing.junit.JUnitTestClassProcessor.processTestClass(JUnitTestClassProcessor.java:66)
> 	at org.gradle.api.internal.tasks.testing.SuiteTestClassProcessor.processTestClass(SuiteTestClassProcessor.java:51)
> 	at sun.reflect.GeneratedMethodAccessor3.invoke(Unknown Source)
> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> 	at java.lang.reflect.Method.invoke(Method.java:498)
> 	at org.gradle.internal.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:35)
> 	at org.gradle.internal.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:24)
> 	at org.gradle.internal.dispatch.ContextClassLoaderDispatch.dispatch(ContextClassLoaderDispatch.java:32)
> 	at org.gradle.internal.dispatch.ProxyDispatchAdapter$DispatchingInvocationHandler.invoke(ProxyDispatchAdapter.java:93)
> 	at com.sun.proxy.$Proxy2.processTestClass(Unknown Source)
> 	at org.gradle.api.internal.tasks.testing.worker.TestWorker.processTestClass(TestWorker.java:109)
> 	at sun.reflect.GeneratedMethodAccessor2.invoke(Unknown Source)
> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> 	at java.lang.reflect.Method.invoke(Method.java:498)
> 	at org.gradle.internal.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:35)
> 	at org.gradle.internal.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:24)
> 	at org.gradle.internal.remote.internal.hub.MessageHubBackedObjectConnection$DispatchWrapper.dispatch(MessageHubBackedObjectConnection.java:147)
> 	at org.gradle.internal.remote.internal.hub.MessageHubBackedObjectConnection$DispatchWrapper.dispatch(MessageHubBackedObjectConnection.java:129)
> 	at org.gradle.internal.remote.internal.hub.MessageHub$Handler.run(MessageHub.java:404)
> 	at org.gradle.internal.concurrent.ExecutorPolicy$CatchAndRecordFailures.onExecute(ExecutorPolicy.java:63)
> 	at org.gradle.internal.concurrent.StoppableExecutorImpl$1.run(StoppableExecutorImpl.java:46)
> 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> 	at java.lang.Thread.run(Thread.java:745)
> {code}
> *Standard Output*
> {code}
> [2017-05-05 22:23:53,206] ERROR ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes (org.apache.zookeeper.server.ZooKeeperServer:472)
> Current partition replica assignment
> {"version":1,"partitions":[{"topic":"my-topic","partition":0,"replicas":[100,101]}]}
> Save this to use as the --reassignment-json-file option during rollback
> Warning: You must run Verify periodically, until the reassignment completes, to ensure the throttle is removed. You can also alter the throttle by rerunning the Execute command passing a new value.
> The throttle limit was set to 10000000 B/s
> Successfully started reassignment of partitions.
> [2017-05-05 22:24:03,427] ERROR ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes (org.apache.zookeeper.server.ZooKeeperServer:472)
> [2017-05-05 22:24:03,483] ERROR ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes (org.apache.zookeeper.server.ZooKeeperServer:472)
> [2017-05-05 22:24:05,122] ERROR ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes (org.apache.zookeeper.server.ZooKeeperServer:472)
> [2017-05-05 22:24:05,138] ERROR ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes (org.apache.zookeeper.server.ZooKeeperServer:472)
> [2017-05-05 22:24:06,185] ERROR [ReplicaFetcherThread-0-104]: Error for partition [topic2,1] to broker 104:org.apache.kafka.common.errors.UnknownTopicOrPartitionException: This server does not host this topic-partition. (kafka.server.ReplicaFetcherThread:99)
> Current partition replica assignment
> {"version":1,"partitions":[{"topic":"topic2","partition":1,"replicas":[104,105]},{"topic":"topic2","partition":0,"replicas":[104,105]},{"topic":"topic1","partition":1,"replicas":[100,101]},{"topic":"topic1","partition":2,"replicas":[103,104]},{"topic":"topic1","partition":0,"replicas":[100,101]},{"topic":"topic2","partition":2,"replicas":[103,104]}]}
> Save this to use as the --reassignment-json-file option during rollback
> Warning: You must run Verify periodically, until the reassignment completes, to ensure the throttle is removed. You can also alter the throttle by rerunning the Execute command passing a new value.
> The throttle limit was set to 1000000 B/s
> Successfully started reassignment of partitions.
> [2017-05-05 22:24:07,067] ERROR [Controller 100]: Error completing reassignment of partition [topic2,2] (kafka.controller.KafkaController:105)
> kafka.common.KafkaException: Partition [topic2,2] to be reassigned is already assigned to replicas 103,104. Ignoring request for partition reassignment
> 	at kafka.controller.KafkaController.initiateReassignReplicasForTopicPartition(KafkaController.scala:553)
> 	at kafka.controller.KafkaController$PartitionReassignment$$anonfun$process$16.apply(KafkaController.scala:1274)
> 	at kafka.controller.KafkaController$PartitionReassignment$$anonfun$process$16.apply(KafkaController.scala:1267)
> 	at scala.collection.immutable.HashMap$HashMap1.foreach(HashMap.scala:221)
> 	at scala.collection.immutable.HashMap$HashTrieMap.foreach(HashMap.scala:428)
> 	at kafka.controller.KafkaController$PartitionReassignment.process(KafkaController.scala:1267)
> 	at kafka.controller.KafkaController$ControllerEventThread.doWork(KafkaController.scala:1147)
> 	at kafka.utils.ShutdownableThread.run(ShutdownableThread.scala:64)
> [2017-05-05 22:24:07,143] ERROR [Controller 100]: Error completing reassignment of partition [topic1,2] (kafka.controller.KafkaController:105)
> kafka.common.KafkaException: Partition [topic1,2] to be reassigned is already assigned to replicas 103,104. Ignoring request for partition reassignment
> 	at kafka.controller.KafkaController.initiateReassignReplicasForTopicPartition(KafkaController.scala:553)
> 	at kafka.controller.KafkaController$PartitionReassignment$$anonfun$process$16.apply(KafkaController.scala:1274)
> 	at kafka.controller.KafkaController$PartitionReassignment$$anonfun$process$16.apply(KafkaController.scala:1267)
> 	at scala.collection.immutable.HashMap$HashMap1.foreach(HashMap.scala:221)
> 	at scala.collection.immutable.HashMap$HashTrieMap.foreach(HashMap.scala:428)
> 	at scala.collection.immutable.HashMap$HashTrieMap.foreach(HashMap.scala:428)
> 	at kafka.controller.KafkaController$PartitionReassignment.process(KafkaController.scala:1267)
> 	at kafka.controller.KafkaController$ControllerEventThread.doWork(KafkaController.scala:1147)
> 	at kafka.utils.ShutdownableThread.run(ShutdownableThread.scala:64)
> [2017-05-05 22:24:07,255] ERROR [Controller 100]: Error completing reassignment of partition [topic1,2] (kafka.controller.KafkaController:105)
> kafka.common.KafkaException: Partition [topic1,2] to be reassigned is already assigned to replicas 103,104. Ignoring request for partition reassignment
> 	at kafka.controller.KafkaController.initiateReassignReplicasForTopicPartition(KafkaController.scala:553)
> 	at kafka.controller.KafkaController$PartitionReassignment$$anonfun$process$16.apply(KafkaController.scala:1274)
> 	at kafka.controller.KafkaController$PartitionReassignment$$anonfun$process$16.apply(KafkaController.scala:1267)
> 	at scala.collection.immutable.HashMap$HashMap1.foreach(HashMap.scala:221)
> 	at kafka.controller.KafkaController$PartitionReassignment.process(KafkaController.scala:1267)
> 	at kafka.controller.KafkaController$ControllerEventThread.doWork(KafkaController.scala:1147)
> 	at kafka.utils.ShutdownableThread.run(ShutdownableThread.scala:64)
> [2017-05-05 22:24:10,139] WARN caught end of stream exception (org.apache.zookeeper.server.NIOServerCnxn:368)
> EndOfStreamException: Unable to read additional data from client sessionid 0x15bdab6800b0003, likely client has closed socket
> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
> 	at java.lang.Thread.run(Thread.java:745)
> [2017-05-05 22:24:11,420] ERROR ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes (org.apache.zookeeper.server.ZooKeeperServer:472)
> [2017-05-05 22:24:11,434] ERROR ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes (org.apache.zookeeper.server.ZooKeeperServer:472)
> Current partition replica assignment
> {"version":1,"partitions":[{"topic":"my-topic","partition":1,"replicas":[100,101]},{"topic":"my-topic","partition":0,"replicas":[100,101]},{"topic":"my-topic","partition":2,"replicas":[100,101]}]}
> Save this to use as the --reassignment-json-file option during rollback
> Successfully started reassignment of partitions.
> [2017-05-05 22:24:12,271] ERROR [Controller 100]: Error completing reassignment of partition [my-topic,1] (kafka.controller.KafkaController:105)
> kafka.common.KafkaException: Partition [my-topic,1] to be reassigned is already assigned to replicas 102,101. Ignoring request for partition reassignment
> 	at kafka.controller.KafkaController.initiateReassignReplicasForTopicPartition(KafkaController.scala:553)
> 	at kafka.controller.KafkaController$PartitionReassignment$$anonfun$process$16.apply(KafkaController.scala:1274)
> 	at kafka.controller.KafkaController$PartitionReassignment$$anonfun$process$16.apply(KafkaController.scala:1267)
> 	at scala.collection.immutable.Map$Map1.foreach(Map.scala:116)
> 	at kafka.controller.KafkaController$PartitionReassignment.process(KafkaController.scala:1267)
> 	at kafka.controller.KafkaController$ControllerEventThread.doWork(KafkaController.scala:1147)
> 	at kafka.utils.ShutdownableThread.run(ShutdownableThread.scala:64)
> [2017-05-05 22:24:16,144] ERROR ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes (org.apache.zookeeper.server.ZooKeeperServer:472)
> [2017-05-05 22:24:16,157] ERROR ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes (org.apache.zookeeper.server.ZooKeeperServer:472)
> [2017-05-05 22:24:18,698] ERROR ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes (org.apache.zookeeper.server.ZooKeeperServer:472)
> [2017-05-05 22:24:18,708] ERROR ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes (org.apache.zookeeper.server.ZooKeeperServer:472)
> [2017-05-05 22:24:20,312] ERROR ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes (org.apache.zookeeper.server.ZooKeeperServer:472)
> [2017-05-05 22:24:20,323] ERROR ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes (org.apache.zookeeper.server.ZooKeeperServer:472)
> Current partition replica assignment
> {"version":1,"partitions":[{"topic":"my-topic","partition":0,"replicas":[100]}]}
> Save this to use as the --reassignment-json-file option during rollback
> Successfully started reassignment of partitions.
> [2017-05-05 22:24:21,782] ERROR ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes (org.apache.zookeeper.server.ZooKeeperServer:472)
> [2017-05-05 22:24:21,797] ERROR ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes (org.apache.zookeeper.server.ZooKeeperServer:472)
> [2017-05-05 22:24:22,037] ERROR [ReplicaFetcherThread-0-102]: Error for partition [my-topic,2] to broker 102:org.apache.kafka.common.errors.UnknownTopicOrPartitionException: This server does not host this topic-partition. (kafka.server.ReplicaFetcherThread:99)
> Current partition replica assignment
> {"version":1,"partitions":[{"topic":"my-topic","partition":1,"replicas":[101,102]},{"topic":"my-topic","partition":0,"replicas":[100,101]},{"topic":"my-topic","partition":2,"replicas":[102,100]}]}
> Save this to use as the --reassignment-json-file option during rollback
> Successfully started reassignment of partitions.
> [2017-05-05 22:24:22,472] ERROR [Controller 100]: Error completing reassignment of partition [my-topic,0] (kafka.controller.KafkaController:105)
> kafka.common.KafkaException: Partition [my-topic,0] to be reassigned is already assigned to replicas 100,101. Ignoring request for partition reassignment
> 	at kafka.controller.KafkaController.initiateReassignReplicasForTopicPartition(KafkaController.scala:553)
> 	at kafka.controller.KafkaController$PartitionReassignment$$anonfun$process$16.apply(KafkaController.scala:1274)
> 	at kafka.controller.KafkaController$PartitionReassignment$$anonfun$process$16.apply(KafkaController.scala:1267)
> 	at scala.collection.immutable.Map$Map3.foreach(Map.scala:161)
> 	at kafka.controller.KafkaController$PartitionReassignment.process(KafkaController.scala:1267)
> 	at kafka.controller.KafkaController$ControllerEventThread.doWork(KafkaController.scala:1147)
> 	at kafka.utils.ShutdownableThread.run(ShutdownableThread.scala:64)
> [2017-05-05 22:24:22,531] ERROR [Controller 100]: Error completing reassignment of partition [my-topic,1] (kafka.controller.KafkaController:105)
> kafka.common.KafkaException: Partition [my-topic,1] to be reassigned is already assigned to replicas 101,100. Ignoring request for partition reassignment
> 	at kafka.controller.KafkaController.initiateReassignReplicasForTopicPartition(KafkaController.scala:553)
> 	at kafka.controller.KafkaController$PartitionReassignment$$anonfun$process$16.apply(KafkaController.scala:1274)
> 	at kafka.controller.KafkaController$PartitionReassignment$$anonfun$process$16.apply(KafkaController.scala:1267)
> 	at scala.collection.immutable.Map$Map1.foreach(Map.scala:116)
> 	at kafka.controller.KafkaController$PartitionReassignment.process(KafkaController.scala:1267)
> 	at kafka.controller.KafkaController$ControllerEventThread.doWork(KafkaController.scala:1147)
> 	at kafka.utils.ShutdownableThread.run(ShutdownableThread.scala:64)
> [2017-05-05 22:24:22,587] ERROR [Controller 100]: Error completing reassignment of partition [my-topic,2] (kafka.controller.KafkaController:105)
> kafka.common.KafkaException: Partition [my-topic,2] to be reassigned is already assigned to replicas 100,101. Ignoring request for partition reassignment
> 	at kafka.controller.KafkaController.initiateReassignReplicasForTopicPartition(KafkaController.scala:553)
> 	at kafka.controller.KafkaController$PartitionReassignment$$anonfun$process$16.apply(KafkaController.scala:1274)
> 	at kafka.controller.KafkaController$PartitionReassignment$$anonfun$process$16.apply(KafkaController.scala:1267)
> 	at scala.collection.immutable.Map$Map1.foreach(Map.scala:116)
> 	at kafka.controller.KafkaController$PartitionReassignment.process(KafkaController.scala:1267)
> 	at kafka.controller.KafkaController$ControllerEventThread.doWork(KafkaController.scala:1147)
> 	at kafka.utils.ShutdownableThread.run(ShutdownableThread.scala:64)
> [2017-05-05 22:24:22,589] ERROR [Controller 100]: Error completing reassignment of partition [my-topic,2] (kafka.controller.KafkaController:105)
> kafka.common.KafkaException: Partition [my-topic,2] to be reassigned is already assigned to replicas 100,101. Ignoring request for partition reassignment
> 	at kafka.controller.KafkaController.initiateReassignReplicasForTopicPartition(KafkaController.scala:553)
> 	at kafka.controller.KafkaController$PartitionReassignment$$anonfun$process$16.apply(KafkaController.scala:1274)
> 	at kafka.controller.KafkaController$PartitionReassignment$$anonfun$process$16.apply(KafkaController.scala:1267)
> 	at scala.collection.immutable.Map$Map1.foreach(Map.scala:116)
> 	at kafka.controller.KafkaController$PartitionReassignment.process(KafkaController.scala:1267)
> 	at kafka.controller.KafkaController$ControllerEventThread.doWork(KafkaController.scala:1147)
> 	at kafka.utils.ShutdownableThread.run(ShutdownableThread.scala:64)
> [2017-05-05 22:24:25,282] ERROR ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes (org.apache.zookeeper.server.ZooKeeperServer:472)
> [2017-05-05 22:24:25,294] ERROR ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes (org.apache.zookeeper.server.ZooKeeperServer:472)
> The throttle limit was set to 1000 B/s
> [2017-05-05 22:24:27,545] ERROR [Controller 0]: Error completing reassignment of partition [orders,1] (kafka.controller.KafkaController:105)
> kafka.common.KafkaException: Partition [orders,1] to be reassigned is already assigned to replicas 0,1,2. Ignoring request for partition reassignment
> 	at kafka.controller.KafkaController.initiateReassignReplicasForTopicPartition(KafkaController.scala:553)
> 	at kafka.controller.KafkaController$PartitionReassignment$$anonfun$process$16.apply(KafkaController.scala:1274)
> 	at kafka.controller.KafkaController$PartitionReassignment$$anonfun$process$16.apply(KafkaController.scala:1267)
> 	at scala.collection.immutable.Map$Map4.foreach(Map.scala:188)
> 	at kafka.controller.KafkaController$PartitionReassignment.process(KafkaController.scala:1267)
> 	at kafka.controller.KafkaController$ControllerEventThread.doWork(KafkaController.scala:1147)
> 	at kafka.utils.ShutdownableThread.run(ShutdownableThread.scala:64)
> [2017-05-05 22:24:27,637] ERROR [Controller 0]: Error completing reassignment of partition [orders,0] (kafka.controller.KafkaController:105)
> kafka.common.KafkaException: Partition [orders,0] to be reassigned is already assigned to replicas 0,2,3. Ignoring request for partition reassignment
> 	at kafka.controller.KafkaController.initiateReassignReplicasForTopicPartition(KafkaController.scala:553)
> 	at kafka.controller.KafkaController$PartitionReassignment$$anonfun$process$16.apply(KafkaController.scala:1274)
> 	at kafka.controller.KafkaController$PartitionReassignment$$anonfun$process$16.apply(KafkaController.scala:1267)
> 	at scala.collection.immutable.Map$Map1.foreach(Map.scala:116)
> 	at kafka.controller.KafkaController$PartitionReassignment.process(KafkaController.scala:1267)
> 	at kafka.controller.KafkaController$ControllerEventThread.doWork(KafkaController.scala:1147)
> 	at kafka.utils.ShutdownableThread.run(ShutdownableThread.scala:64)
> [2017-05-05 22:24:28,114] ERROR [Controller 0]: Error completing reassignment of partition [deliveries,0] (kafka.controller.KafkaController:105)
> kafka.common.KafkaException: Partition [deliveries,0] to be reassigned is already assigned to replicas 1,2. Ignoring request for partition reassignment
> 	at kafka.controller.KafkaController.initiateReassignReplicasForTopicPartition(KafkaController.scala:553)
> 	at kafka.controller.KafkaController$PartitionReassignment$$anonfun$process$16.apply(KafkaController.scala:1274)
> 	at kafka.controller.KafkaController$PartitionReassignment$$anonfun$process$16.apply(KafkaController.scala:1267)
> 	at scala.collection.immutable.Map$Map1.foreach(Map.scala:116)
> 	at kafka.controller.KafkaController$PartitionReassignment.process(KafkaController.scala:1267)
> 	at kafka.controller.KafkaController$ControllerEventThread.doWork(KafkaController.scala:1147)
> 	at kafka.utils.ShutdownableThread.run(ShutdownableThread.scala:64)
> [2017-05-05 22:24:31,022] ERROR ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes (org.apache.zookeeper.server.ZooKeeperServer:472)
> [2017-05-05 22:24:31,040] ERROR ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes (org.apache.zookeeper.server.ZooKeeperServer:472)
> Current partition replica assignment
> {"version":1,"partitions":[{"topic":"my-topic","partition":0,"replicas":[100,101]}]}
> Save this to use as the --reassignment-json-file option during rollback
> Warning: You must run Verify periodically, until the reassignment completes, to ensure the throttle is removed. You can also alter the throttle by rerunning the Execute command passing a new value.
> The throttle limit was set to 1000000 B/s
> Successfully started reassignment of partitions.
> Status of partition reassignment: 
> Reassignment of partition [my-topic,0] is still in progress
> There is an existing assignment running.
> [2017-05-05 22:24:50,684] ERROR ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes (org.apache.zookeeper.server.ZooKeeperServer:472)
> [2017-05-05 22:24:50,734] ERROR ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes (org.apache.zookeeper.server.ZooKeeperServer:472)
> Current partition replica assignment
> {"version":1,"partitions":[{"topic":"topic2","partition":1,"replicas":[101,102]},{"topic":"topic2","partition":0,"replicas":[100,101]},{"topic":"topic1","partition":1,"replicas":[101,102]},{"topic":"topic1","partition":2,"replicas":[102,100]},{"topic":"topic1","partition":0,"replicas":[100,101]},{"topic":"topic2","partition":2,"replicas":[102,100]}]}
> Save this to use as the --reassignment-json-file option during rollback
> Successfully started reassignment of partitions.
> [2017-05-05 22:24:51,982] ERROR [Controller 100]: Error completing reassignment of partition [topic1,0] (kafka.controller.KafkaController:105)
> kafka.common.KafkaException: Partition [topic1,0] to be reassigned is already assigned to replicas 100,102. Ignoring request for partition reassignment
> 	at kafka.controller.KafkaController.initiateReassignReplicasForTopicPartition(KafkaController.scala:553)
> 	at kafka.controller.KafkaController$PartitionReassignment$$anonfun$process$16.apply(KafkaController.scala:1274)
> 	at kafka.controller.KafkaController$PartitionReassignment$$anonfun$process$16.apply(KafkaController.scala:1267)
> 	at scala.collection.immutable.Map$Map2.foreach(Map.scala:137)
> 	at kafka.controller.KafkaController$PartitionReassignment.process(KafkaController.scala:1267)
> 	at kafka.controller.KafkaController$ControllerEventThread.doWork(KafkaController.scala:1147)
> 	at kafka.utils.ShutdownableThread.run(ShutdownableThread.scala:64)
> [2017-05-05 22:24:51,989] ERROR [Controller 100]: Error completing reassignment of partition [topic2,2] (kafka.controller.KafkaController:105)
> kafka.common.KafkaException: Partition [topic2,2] to be reassigned is already assigned to replicas 100,102. Ignoring request for partition reassignment
> 	at kafka.controller.KafkaController.initiateReassignReplicasForTopicPartition(KafkaController.scala:553)
> 	at kafka.controller.KafkaController$PartitionReassignment$$anonfun$process$16.apply(KafkaController.scala:1274)
> 	at kafka.controller.KafkaController$PartitionReassignment$$anonfun$process$16.apply(KafkaController.scala:1267)
> 	at scala.collection.immutable.Map$Map2.foreach(Map.scala:137)
> 	at kafka.controller.KafkaController$PartitionReassignment.process(KafkaController.scala:1267)
> 	at kafka.controller.KafkaController$ControllerEventThread.doWork(KafkaController.scala:1147)
> 	at kafka.utils.ShutdownableThread.run(ShutdownableThread.scala:64)
> [2017-05-05 22:24:51,993] ERROR [Controller 100]: Error completing reassignment of partition [topic1,0] (kafka.controller.KafkaController:105)
> kafka.common.KafkaException: Partition [topic1,0] to be reassigned is already assigned to replicas 100,102. Ignoring request for partition reassignment
> 	at kafka.controller.KafkaController.initiateReassignReplicasForTopicPartition(KafkaController.scala:553)
> 	at kafka.controller.KafkaController$PartitionReassignment$$anonfun$process$16.apply(KafkaController.scala:1274)
> 	at kafka.controller.KafkaController$PartitionReassignment$$anonfun$process$16.apply(KafkaController.scala:1267)
> 	at scala.collection.immutable.Map$Map1.foreach(Map.scala:116)
> 	at kafka.controller.KafkaController$PartitionReassignment.process(KafkaController.scala:1267)
> 	at kafka.controller.KafkaController$ControllerEventThread.doWork(KafkaController.scala:1147)
> 	at kafka.utils.ShutdownableThread.run(ShutdownableThread.scala:64)
> [2017-05-05 22:24:54,342] ERROR ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes (org.apache.zookeeper.server.ZooKeeperServer:472)
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)