You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@kafka.apache.org by "Ron Dagostino (Jira)" <ji...@apache.org> on 2023/02/20 19:21:00 UTC
[jira] [Created] (KAFKA-14735) Improve KRaft metadata image change performance at high topic counts
Ron Dagostino created KAFKA-14735:
-------------------------------------
Summary: Improve KRaft metadata image change performance at high topic counts
Key: KAFKA-14735
URL: https://issues.apache.org/jira/browse/KAFKA-14735
Project: Kafka
Issue Type: Improvement
Components: kraft
Reporter: Ron Dagostino
Assignee: Ron Dagostino
Fix For: 3.5.0
Performance of KRaft metadata image changes is currently O(<# of topics in cluster>). This means the amount of time it takes to create just a *single* topic scales linearly with the number of topics in the entire cluster. This impact both controllers and brokers because both use the metadata image to represent the KRaft metadata log. The performance of these changes should scale with the number of topics being changed -- so creating a single topic should perform similarly regardless of the number of topics in the cluster.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)