[jira] [Commented] (KAFKA-10373) Kafka Reassign Partition is stuck with Java OutOfMemory error

[" Brajesh Kumar (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/KAFKA-10373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17223041#comment-17223041 ] 

 Brajesh Kumar commented on KAFKA-10373:
----------------------------------------

Hi What is your Environment configurations(Linux/MAC OS)? Do you have any ACL set on the cluster?

 

Can you please share the steps to reproduce the issue. I am unable to reproduce the issue on Amazon Linux.

 

 
{code:java}
 
dev-dsk-brjkumar-1c-3f1604a7 % ./kafka-reassign-partitions.sh --zookeeper localhost:2181 --reassignment-json-file topics-reassignment.json --bootstrap-server localhost:9093 --execute
Current partition replica assignment
{"version":1,"partitions":[{"topic":"test","partition":2,"replicas":[2,1],"log_dirs":["any","any"]},{"topic":"test","partition":1,"replicas":[1,2],"log_dirs":["any","any"]},{"topic":"test","partition":3,"replicas":[1,2],"log_dirs":["any","any"]},{"topic":"test","partition":0,"replicas":[2,1],"log_dirs":["any","any"]}]}
Save this to use as the --reassignment-json-file option during rollback
Successfully started reassignment of partitions.
(20-10-29 16:55:05) <0> [~/kafka/kafka_2.11-2.2.1/bin]
dev-dsk-brjkumar-1c-3f1604a7 % ./kafka-reassign-partitions.sh --zookeeper localhost:2181 --reassignment-json-file topics-reassignment.json --bootstrap-server localhost:9093 --verify
Status of partition reassignment:
Reassignment of partition test-1 completed successfully
Reassignment of partition test-3 completed successfully
Reassignment of partition test-0 completed successfully
Reassignment of partition test-2 completed successfully{code}
 

> Kafka Reassign Partition is stuck with Java OutOfMemory error
> -------------------------------------------------------------
>
>                 Key: KAFKA-10373
>                 URL: https://issues.apache.org/jira/browse/KAFKA-10373
>             Project: Kafka
>          Issue Type: Bug
>          Components: core
>    Affects Versions: 2.2.1
>            Reporter: azher khan
>            Priority: Major
>
> Hi Team,
> While trying to run the Kafka script to reassign partitions of an existing topic, we are seeing a Java OutOfMemory issue.
>  
> The heap for Kafka is set to "-Xmx1G -Xms1G" on the kafka broker.
>  
> {code:java}
> /opt/kafka/bin/kafka-reassign-partitions.sh --zookeeper zookeeper1:2181 --reassignment-json-file topic_kafka_topic1_reassignment.json --bootstrap-server kafkabroker1:9092 --verify
> Status of partition reassignment:
> [2020-08-07 XX:XX:XX,xxxx] ERROR Uncaught exception in thread 'kafka-admin-client-thread | reassign-partitions-tool': (org.apache.kafka.common.utils.KafkaThread)
> java.lang.OutOfMemoryError: Java heap space
>  at java.nio.HeapByteBuffer.<init>(HeapByteBuffer.java:57)
>  at java.nio.ByteBuffer.allocate(ByteBuffer.java:335)
>  at org.apache.kafka.common.memory.MemoryPool$1.tryAllocate(MemoryPool.java:30)
>  at org.apache.kafka.common.network.NetworkReceive.readFrom(NetworkReceive.java:112)
>  at org.apache.kafka.common.network.KafkaChannel.receive(KafkaChannel.java:335)
>  at org.apache.kafka.common.network.KafkaChannel.read(KafkaChannel.java:296)
>  at org.apache.kafka.common.network.Selector.attemptRead(Selector.java:560)
>  at org.apache.kafka.common.network.Selector.pollSelectionKeys(Selector.java:496)
>  at org.apache.kafka.common.network.Selector.poll(Selector.java:425)
>  at org.apache.kafka.clients.NetworkClient.poll(NetworkClient.java:510)
>  at org.apache.kafka.clients.admin.KafkaAdminClient$AdminClientRunnable.run(KafkaAdminClient.java:1116)
>  at java.lang.Thread.run(Thread.java:748)
> Reassignment of partition kafka_topic1-0 is still in progress
> Reassignment of partition kafka_topic1-1 is still in progress
> Reassignment of partition kafka_topic1-2 is still in progress{code}
>  
> Retried the above command after removing the "reassign_partitions" from zookeeper as suggested but we are seeing the same error.
>  
>  
> {code:java}
> [zk: localhost:2181(CONNECTED) 5] delete /admin/reassign_partitions
> [zk: localhost:2181(CONNECTED) 7] ls /admin
> [delete_topics] 
> {code}
>  
> Would highly appreciate your advice,
> Thank you in advance,
>  
> Regards,
> Azher Khan



--
This message was sent by Atlassian Jira
(v8.3.4#803005)