You are viewing a plain text version of this content. The canonical link for it is here.

Posted to jira@kafka.apache.org by "Michail (Jira)" <ji...@apache.org> on 2021/09/24 10:39:00 UTC

[jira] [Created] (KAFKA-13322) Java client produces a large amount of garbage during a poll

Michail created KAFKA-13322:
-------------------------------

             Summary: Java client produces a large amount of garbage during a poll
                 Key: KAFKA-13322
                 URL: https://issues.apache.org/jira/browse/KAFKA-13322
             Project: Kafka
          Issue Type: Improvement
          Components: clients
    Affects Versions: 3.0.0
            Reporter: Michail


The java kafka consumer creates multiple collections during a single poll command: in my test system i have a consumer that polls a topic with 100 partitions and even though no messages are coming through, the code allocates around 100M per 5 minutes.
 
I've investigated the allocations and the biggest ones can be easily avoided by moving them to the instance level, something that can be done as KafkaConsumer is not thread safe. Purpose of this Jira is to get rid of most of them applying either this or a similar approach.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)