[jira] [Created] (KAFKA-10373) Kafka Reassign Partition is stuck with Java OutOfMemory error

["azher khan (Jira)" <ji...@apache.org>]

azher khan created KAFKA-10373:
----------------------------------

             Summary: Kafka Reassign Partition is stuck with Java OutOfMemory error
                 Key: KAFKA-10373
                 URL: https://issues.apache.org/jira/browse/KAFKA-10373
             Project: Kafka
          Issue Type: Bug
          Components: KafkaConnect
    Affects Versions: 2.2.1
            Reporter: azher khan


Hi Team,

While trying to run the Kafka script to reassign partitions of an existing topic, we are seeing a Java OutOfMemory issue.

 

The heap for Kafka is set to "-Xmx1G -Xms1G" on the kafka broker.

 
{code:java}
/opt/kafka/bin/kafka-reassign-partitions.sh --zookeeper zookeeper1:2181 --reassignment-json-file topic_kafka_topic1_reassignment.json --bootstrap-server kafkabroker1:9092 --verify
Status of partition reassignment:
[2020-08-07 XX:XX:XX,xxxx] ERROR Uncaught exception in thread 'kafka-admin-client-thread | reassign-partitions-tool': (org.apache.kafka.common.utils.KafkaThread)
java.lang.OutOfMemoryError: Java heap space
 at java.nio.HeapByteBuffer.<init>(HeapByteBuffer.java:57)
 at java.nio.ByteBuffer.allocate(ByteBuffer.java:335)
 at org.apache.kafka.common.memory.MemoryPool$1.tryAllocate(MemoryPool.java:30)
 at org.apache.kafka.common.network.NetworkReceive.readFrom(NetworkReceive.java:112)
 at org.apache.kafka.common.network.KafkaChannel.receive(KafkaChannel.java:335)
 at org.apache.kafka.common.network.KafkaChannel.read(KafkaChannel.java:296)
 at org.apache.kafka.common.network.Selector.attemptRead(Selector.java:560)
 at org.apache.kafka.common.network.Selector.pollSelectionKeys(Selector.java:496)
 at org.apache.kafka.common.network.Selector.poll(Selector.java:425)
 at org.apache.kafka.clients.NetworkClient.poll(NetworkClient.java:510)
 at org.apache.kafka.clients.admin.KafkaAdminClient$AdminClientRunnable.run(KafkaAdminClient.java:1116)
 at java.lang.Thread.run(Thread.java:748)
Reassignment of partition kafka_topic1-0 is still in progress
Reassignment of partition kafka_topic1-1 is still in progress
Reassignment of partition kafka_topic1-2 is still in progress{code}
 

Retried the above command after removing the "reassign_partitions" from zookeeper as suggested but we are seeing the same error.

 

 
{code:java}
[zk: localhost:2181(CONNECTED) 5] delete /admin/reassign_partitions
[zk: localhost:2181(CONNECTED) 7] ls /admin
[delete_topics] 
{code}
 

Would highly appreciate your advice,

Thank you in advance,

 

Regards,

Azher Khan



--
This message was sent by Atlassian Jira
(v8.3.4#803005)