You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@kafka.apache.org by "Alexandre Dupriez (Jira)" <ji...@apache.org> on 2020/05/16 12:11:00 UTC
[jira] [Commented] (KAFKA-8898) if there is no message for poll,
kafka consumer also apply memory
[ https://issues.apache.org/jira/browse/KAFKA-8898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17109029#comment-17109029 ]
Alexandre Dupriez commented on KAFKA-8898:
------------------------------------------
Could you please provide some data on the memory consumption of the objects highlighted? Do you have any heap dump available?
> if there is no message for poll, kafka consumer also apply memory
> -----------------------------------------------------------------
>
> Key: KAFKA-8898
> URL: https://issues.apache.org/jira/browse/KAFKA-8898
> Project: Kafka
> Issue Type: Bug
> Components: consumer
> Affects Versions: 2.1.1
> Reporter: linking12
> Priority: Critical
> Labels: performance
> Attachments: image-2019-10-08-12-07-37-328.png
>
>
> when poll message, but there is no record,but consumer will apply 1000 byte memory;
> fetched = *new* HashMap<>() is not good idea, it will apply memory in heap but there is no message;
> I think fetched = *new* HashMap<>() will appear in records exist;
>
> ```
> *public* Map<TopicPartition, List<ConsumerRecord<K, V>>> fetchedRecords() {
> Map<TopicPartition, List<ConsumerRecord<K, V>>> fetched = *new* HashMap<>();
> *int* recordsRemaining = maxPollRecords;
> ```
--
This message was sent by Atlassian Jira
(v8.3.4#803005)