You are viewing a plain text version of this content. The canonical link for it is here.

Posted to jira@kafka.apache.org by "Satish (Jira)" <ji...@apache.org> on 2020/03/02 19:57:00 UTC

[jira] [Comment Edited] (KAFKA-9609) Memory Leak in Kafka Producer

    [ https://issues.apache.org/jira/browse/KAFKA-9609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17049597#comment-17049597 ] 

Satish edited comment on KAFKA-9609 at 3/2/20 7:56 PM:
-------------------------------------------------------

[~sliebau] Is it possible to expose the Metrics so that  we can clear the Topic related Metrics when the topic has been deleted? Can it be considered as an improvement story?


was (Author: satish.gudluru@gmail.com):
[~sliebau] Is it possible to expose the Metrics so that  we can clear the Topic related Metrics when the topic has been deleted? Can you consider this as an improvement story?

> Memory Leak in Kafka Producer
> -----------------------------
>
>                 Key: KAFKA-9609
>                 URL: https://issues.apache.org/jira/browse/KAFKA-9609
>             Project: Kafka
>          Issue Type: Bug
>          Components: clients, producer 
>    Affects Versions: 2.4.0
>            Reporter: Satish
>            Assignee: Sönke Liebau
>            Priority: Major
>
> org.apache.kafka.clients.producer.internals.Sender adds Topic Metrics for every topic that we are writing messages to but it never been cleaned up until we close the producer.
> This is an issue if we use single producer and have more number of Dynamic topics (eg: ~ 500 topics per hour) and writing messages to them.  As this Metrics map is getting accumulated for every topic, over a period of time we notice the memory usage gets increased gradually. 
> It can be easily reproducible by writing messages to the more # of dynamic topics using the same KafkaProducer from apache kafka client libraries or KafkaTemplate from Spring.
>  



--
This message was sent by Atlassian Jira
(v8.3.4#803005)