You are viewing a plain text version of this content. The canonical link for it is here.

Posted to jira@kafka.apache.org by "Ron Dagostino (Jira)" <ji...@apache.org> on 2023/04/18 13:23:00 UTC

[jira] [Resolved] (KAFKA-14735) Improve KRaft metadata image change performance at high topic counts

     [ https://issues.apache.org/jira/browse/KAFKA-14735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Ron Dagostino resolved KAFKA-14735.
-----------------------------------
    Resolution: Fixed

> Improve KRaft metadata image change performance at high topic counts
> --------------------------------------------------------------------
>
>                 Key: KAFKA-14735
>                 URL: https://issues.apache.org/jira/browse/KAFKA-14735
>             Project: Kafka
>          Issue Type: Improvement
>          Components: kraft
>            Reporter: Ron Dagostino
>            Assignee: Ron Dagostino
>            Priority: Major
>             Fix For: 3.6.0
>
>
> Performance of KRaft metadata image changes is currently O(<# of topics in cluster>).  This means the amount of time it takes to create just a *single* topic scales linearly with the number of topics in the entire cluster.  This impact both controllers and brokers because both use the metadata image to represent the KRaft metadata log.  The performance of these changes should scale with the number of topics being changed -- so creating a single topic should perform similarly regardless of the number of topics in the cluster.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)