You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@kafka.apache.org by "Satish (Jira)" <ji...@apache.org> on 2020/02/25 22:55:00 UTC

[jira] [Created] (KAFKA-9609) Memory Leak in Kafka Producer

Satish created KAFKA-9609:
-----------------------------

             Summary: Memory Leak in Kafka Producer
                 Key: KAFKA-9609
                 URL: https://issues.apache.org/jira/browse/KAFKA-9609
             Project: Kafka
          Issue Type: Bug
          Components: clients, producer 
    Affects Versions: 2.4.0
            Reporter: Satish


org.apache.kafka.clients.producer.internals.Sender adds Topic Metrics for every topic that we are writing messages to but it never been cleaned up until we close the producer.

This is an issue if we use single producer and have more number of Dynamic topics (eg: ~ 500 topics per hour) and writing messages to them.  As this Metrics map is getting accumulated for every topic, over a period of time we notice the memory usage gets increased gradually. 

It can be easily reproducible by writing messages to the more # of dynamic topics using the same KafkaProducer from apache kafka client libraries or KafkaTemplate from Spring.

 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)