You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@kafka.apache.org by "PoAn Yang (Jira)" <ji...@apache.org> on 2024/09/19 03:45:00 UTC

[jira] [Commented] (KAFKA-17578) Remove partitionRacks from TopicMetadata

    [ https://issues.apache.org/jira/browse/KAFKA-17578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17882856#comment-17882856 ] 

PoAn Yang commented on KAFKA-17578:
-----------------------------------

Hi [~jeffkbkim], if you're not working on this issue, may I take it? Thank you.

> Remove partitionRacks from TopicMetadata
> ----------------------------------------
>
>                 Key: KAFKA-17578
>                 URL: https://issues.apache.org/jira/browse/KAFKA-17578
>             Project: Kafka
>          Issue Type: Sub-task
>            Reporter: Jeff Kim
>            Priority: Major
>              Labels: kip-848
>
> The ModernGroup#subscribedTopicMetadata takes too much memory due to 
> partitionRacks:
> /**
> * Map of every partition Id to a set of its rack Ids, if they exist.
> * If rack information is unavailable for all partitions, this is an empty map.
> */
> private final Map<Integer, Set<String>> partitionRacks;
>  
> This is not being used at the moment as the consumer protocol does not support rack aware assignments.
>  
> A heap dump from a group with 500 members, 2K subscribed topic partitions shows
> 654,400 bytes used for partitionRacks. The rest of the ConsumerGroup object holds 822,860 bytes. 



--
This message was sent by Atlassian Jira
(v8.20.10#820010)