You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@kafka.apache.org by "Ron Dagostino (Jira)" <ji...@apache.org> on 2023/02/20 19:21:00 UTC

[jira] [Created] (KAFKA-14735) Improve KRaft metadata image change performance at high topic counts

Ron Dagostino created KAFKA-14735:
-------------------------------------

             Summary: Improve KRaft metadata image change performance at high topic counts
                 Key: KAFKA-14735
                 URL: https://issues.apache.org/jira/browse/KAFKA-14735
             Project: Kafka
          Issue Type: Improvement
          Components: kraft
            Reporter: Ron Dagostino
            Assignee: Ron Dagostino
             Fix For: 3.5.0


Performance of KRaft metadata image changes is currently O(<# of topics in cluster>).  This means the amount of time it takes to create just a *single* topic scales linearly with the number of topics in the entire cluster.  This impact both controllers and brokers because both use the metadata image to represent the KRaft metadata log.  The performance of these changes should scale with the number of topics being changed -- so creating a single topic should perform similarly regardless of the number of topics in the cluster.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)