[jira] [Commented] (KAFKA-6078) Investigate failure of ReassignPartitionsClusterTest.shouldExpandCluster

["Matthias J. Sax (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/KAFKA-6078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16796420#comment-16796420 ] 

Matthias J. Sax commented on KAFKA-6078:
----------------------------------------

Failed again: [https://builds.apache.org/blue/organizations/jenkins/kafka-trunk-jdk8/detail/kafka-trunk-jdk8/3475/tests]
{quote}java.lang.AssertionError: Partition should have been moved to the expected log directory on broker 100
at kafka.utils.TestUtils$.fail(TestUtils.scala:381)
at kafka.utils.TestUtils$.waitUntilTrue(TestUtils.scala:791)
at kafka.admin.ReassignPartitionsClusterTest.shouldExpandCluster(ReassignPartitionsClusterTest.scala:190){quote}
STDOUT
{quote}2019-03-19 01:20:43,339] ERROR [ReplicaFetcher replicaId=101, leaderId=100, fetcherId=0] Error for partition my-topic-0 at offset 0 (kafka.server.ReplicaFetcherThread:76)
org.apache.kafka.common.errors.UnknownTopicOrPartitionException: This server does not host this topic-partition.
Current partition replica assignment
 
{"version":1,"partitions":[\{"topic":"my-topic","partition":0,"replicas":[100,101],"log_dirs":["any","any"]}]}
 
Save this to use as the --reassignment-json-file option during rollback
Warning: You must run Verify periodically, until the reassignment completes, to ensure the throttle is removed. You can also alter the throttle by rerunning the Execute command passing a new value.
The inter-broker throttle limit was set to 10000000 B/s
Successfully started reassignment of partitions.
Current partition replica assignment
 
{"version":1,"partitions":[\{"topic":"my-topic","partition":0,"replicas":[100],"log_dirs":["any"]}]}
 
Save this to use as the --reassignment-json-file option during rollback
Successfully started reassignment of partitions.
[2019-03-19 01:20:58,605] ERROR [ReplicaFetcher replicaId=2, leaderId=1, fetcherId=0] Error for partition orders-1 at offset 0 (kafka.server.ReplicaFetcherThread:76)
org.apache.kafka.common.errors.UnknownTopicOrPartitionException: This server does not host this topic-partition.
[2019-03-19 01:21:05,636] ERROR [Controller id=0] Ignoring request to reassign partition customers-0 that doesn't exist. (kafka.controller.KafkaController:74)
[2019-03-19 01:21:11,383] ERROR [ReplicaFetcher replicaId=104, leaderId=103, fetcherId=0] Error for partition topic1-2 at offset 0 (kafka.server.ReplicaFetcherThread:76)
org.apache.kafka.common.errors.UnknownTopicOrPartitionException: This server does not host this topic-partition.
[2019-03-19 01:21:11,390] ERROR [ReplicaFetcher replicaId=101, leaderId=100, fetcherId=0] Error for partition topic1-0 at offset 0 (kafka.server.ReplicaFetcherThread:76)
org.apache.kafka.common.errors.UnknownTopicOrPartitionException: This server does not host this topic-partition.
[2019-03-19 01:21:11,390] ERROR [ReplicaFetcher replicaId=101, leaderId=100, fetcherId=0] Error for partition topic1-1 at offset 0 (kafka.server.ReplicaFetcherThread:76)
org.apache.kafka.common.errors.UnknownTopicOrPartitionException: This server does not host this topic-partition.
[2019-03-19 01:21:11,801] ERROR [ReplicaFetcher replicaId=105, leaderId=104, fetcherId=0] Error for partition topic2-1 at offset 0 (kafka.server.ReplicaFetcherThread:76)
org.apache.kafka.common.errors.UnknownTopicOrPartitionException: This server does not host this topic-partition.
[2019-03-19 01:21:11,801] ERROR [ReplicaFetcher replicaId=105, leaderId=104, fetcherId=0] Error for partition topic2-0 at offset 0 (kafka.server.ReplicaFetcherThread:76)
org.apache.kafka.common.errors.UnknownTopicOrPartitionException: This server does not host this topic-partition.
Current partition replica assignment
 
{"version":1,"partitions":[\{"topic":"topic1","partition":2,"replicas":[103,104],"log_dirs":["any","any"]},\{"topic":"topic2","partition":0,"replicas":[104,105],"log_dirs":["any","any"]},\{"topic":"topic2","partition":1,"replicas":[104,105],"log_dirs":["any","any"]},\{"topic":"topic1","partition":0,"replicas":[100,101],"log_dirs":["any","any"]},\{"topic":"topic1","partition":1,"replicas":[100,101],"log_dirs":["any","any"]},\{"topic":"topic2","partition":2,"replicas":[103,104],"log_dirs":["any","any"]}]}
 
Save this to use as the --reassignment-json-file option during rollback
Warning: You must run Verify periodically, until the reassignment completes, to ensure the throttle is removed. You can also alter the throttle by rerunning the Execute command passing a new value.
The inter-broker throttle limit was set to 1000000 B/s
Successfully started reassignment of partitions.
[2019-03-19 01:21:18,518] ERROR [ReplicaFetcher replicaId=101, leaderId=100, fetcherId=0] Error for partition my-topic-1 at offset 0 (kafka.server.ReplicaFetcherThread:76)
org.apache.kafka.common.errors.UnknownTopicOrPartitionException: This server does not host this topic-partition.
[2019-03-19 01:21:18,518] ERROR [ReplicaFetcher replicaId=101, leaderId=100, fetcherId=0] Error for partition my-topic-0 at offset 0 (kafka.server.ReplicaFetcherThread:76)
org.apache.kafka.common.errors.UnknownTopicOrPartitionException: This server does not host this topic-partition.
[2019-03-19 01:21:18,518] ERROR [ReplicaFetcher replicaId=101, leaderId=100, fetcherId=0] Error for partition my-topic-2 at offset 0 (kafka.server.ReplicaFetcherThread:76)
org.apache.kafka.common.errors.UnknownTopicOrPartitionException: This server does not host this topic-partition.
Current partition replica assignment
 
{"version":1,"partitions":[\{"topic":"my-topic","partition":0,"replicas":[100,101],"log_dirs":["any","any"]},\{"topic":"my-topic","partition":1,"replicas":[100,101],"log_dirs":["any","any"]},\{"topic":"my-topic","partition":2,"replicas":[100,101],"log_dirs":["any","any"]}]}
 
Save this to use as the --reassignment-json-file option during rollback
Successfully started reassignment of partitions.
[2019-03-19 01:21:22,458] WARN Unable to read additional data from client sessionid 0x1046786fc860000, likely client has closed socket (org.apache.zookeeper.server.NIOServerCnxn:376)
Current partition replica assignment
 
{"version":1,"partitions":[\{"topic":"my-topic","partition":0,"replicas":[100],"log_dirs":["any"]}]}
 
Save this to use as the --reassignment-json-file option during rollback
[2019-03-19 01:21:23,917] WARN Unable to read additional data from client sessionid 0x10467870d820000, likely client has closed socket (org.apache.zookeeper.server.NIOServerCnxn:376)
Current partition replica assignment
 
{"version":1,"partitions":[\{"topic":"my-topic","partition":0,"replicas":[100],"log_dirs":["any"]}]}
 
Save this to use as the --reassignment-json-file option during rollback
Successfully started reassignment of partitions.
[2019-03-19 01:21:32,580] ERROR [ReplicaFetcher replicaId=1, leaderId=0, fetcherId=0] Error for partition orders-0 at offset 0 (kafka.server.ReplicaFetcherThread:76)
org.apache.kafka.common.errors.UnknownTopicOrPartitionException: This server does not host this topic-partition.
[2019-03-19 01:21:32,581] ERROR [ReplicaFetcher replicaId=1, leaderId=0, fetcherId=0] Error for partition orders-1 at offset 0 (kafka.server.ReplicaFetcherThread:76)
org.apache.kafka.common.errors.UnknownTopicOrPartitionException: This server does not host this topic-partition.
[2019-03-19 01:21:32,581] ERROR [ReplicaFetcher replicaId=2, leaderId=0, fetcherId=0] Error for partition orders-0 at offset 0 (kafka.server.ReplicaFetcherThread:76)
org.apache.kafka.common.errors.UnknownTopicOrPartitionException: This server does not host this topic-partition.
[2019-03-19 01:21:32,582] ERROR [ReplicaFetcher replicaId=2, leaderId=0, fetcherId=0] Error for partition orders-1 at offset 0 (kafka.server.ReplicaFetcherThread:76)
org.apache.kafka.common.errors.UnknownTopicOrPartitionException: This server does not host this topic-partition.
[2019-03-19 01:21:37,802] ERROR [ReplicaFetcher replicaId=101, leaderId=100, fetcherId=0] Error for partition my-topic-0 at offset 0 (kafka.server.ReplicaFetcherThread:76)
org.apache.kafka.common.errors.UnknownTopicOrPartitionException: This server does not host this topic-partition.
Current partition replica assignment
 
{"version":1,"partitions":[\{"topic":"my-topic","partition":0,"replicas":[100,101],"log_dirs":["any","any"]},\{"topic":"my-topic","partition":1,"replicas":[101,102],"log_dirs":["any","any"]},\{"topic":"my-topic","partition":2,"replicas":[102,100],"log_dirs":["any","any"]}]}
 
Save this to use as the --reassignment-json-file option during rollback
Successfully started reassignment of partitions.
Current partition replica assignment
 
{"version":1,"partitions":[\{"topic":"my-topic","partition":0,"replicas":[100],"log_dirs":["any"]}]}
 
Save this to use as the --reassignment-json-file option during rollback
Successfully started reassignment of partitions.
[2019-03-19 01:21:44,278] ERROR [ReplicaFetcher replicaId=1, leaderId=0, fetcherId=0] Error for partition orders-0 at offset 0 (kafka.server.ReplicaFetcherThread:76)
org.apache.kafka.common.errors.UnknownTopicOrPartitionException: This server does not host this topic-partition.
[2019-03-19 01:21:44,280] ERROR [ReplicaFetcher replicaId=1, leaderId=0, fetcherId=0] Error for partition orders-1 at offset 0 (kafka.server.ReplicaFetcherThread:76)
org.apache.kafka.common.errors.UnknownTopicOrPartitionException: This server does not host this topic-partition.
The inter-broker throttle limit was set to 1000 B/s
[2019-03-19 01:21:46,625] WARN Unable to read additional data from client sessionid 0x1046787612a0003, likely client has closed socket (org.apache.zookeeper.server.NIOServerCnxn:376)
[2019-03-19 01:21:48,470] ERROR [ReplicaFetcher replicaId=101, leaderId=100, fetcherId=0] Error for partition my-topic-0 at offset 0 (kafka.server.ReplicaFetcherThread:76)
org.apache.kafka.common.errors.UnknownTopicOrPartitionException: This server does not host this topic-partition.
Current partition replica assignment
 
{"version":1,"partitions":[\{"topic":"my-topic","partition":0,"replicas":[100,101],"log_dirs":["any","any"]}]}
 
Save this to use as the --reassignment-json-file option during rollback
Warning: You must run Verify periodically, until the reassignment completes, to ensure the throttle is removed. You can also alter the throttle by rerunning the Execute command passing a new value.
The inter-broker throttle limit was set to 1000000 B/s
Successfully started reassignment of partitions.
Status of partition reassignment:
Reassignment of partition my-topic-0 is still in progress
There is an existing assignment running.
Status of partition reassignment:
Reassignment of partition my-topic-0 completed successfully
Throttle was removed.
[2019-03-19 01:21:50,698] ERROR [ReplicaFetcher replicaId=102, leaderId=101, fetcherId=0] Error for partition topic1-1 at offset 0 (kafka.server.ReplicaFetcherThread:76)
org.apache.kafka.common.errors.UnknownTopicOrPartitionException: This server does not host this topic-partition.
Current partition replica assignment
 
{"version":1,"partitions":[\{"topic":"topic1","partition":2,"replicas":[102,100],"log_dirs":["any","any"]},\{"topic":"topic2","partition":0,"replicas":[100,101],"log_dirs":["any","any"]},\{"topic":"topic2","partition":1,"replicas":[101,102],"log_dirs":["any","any"]},\{"topic":"topic1","partition":0,"replicas":[100,101],"log_dirs":["any","any"]},\{"topic":"topic1","partition":1,"replicas":[101,102],"log_dirs":["any","any"]},\{"topic":"topic2","partition":2,"replicas":[102,100],"log_dirs":["any","any"]}]}
 
Save this to use as the --reassignment-json-file option during rollback
Successfully started reassignment of partitions.{quote}

> Investigate failure of ReassignPartitionsClusterTest.shouldExpandCluster
> ------------------------------------------------------------------------
>
>                 Key: KAFKA-6078
>                 URL: https://issues.apache.org/jira/browse/KAFKA-6078
>             Project: Kafka
>          Issue Type: Bug
>          Components: unit tests
>            Reporter: Dong Lin
>            Priority: Major
>
> See https://github.com/apache/kafka/pull/4084



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)