You are viewing a plain text version of this content. The canonical link for it is here.

Posted to jira@kafka.apache.org by "Chia-Ping Tsai (Jira)" <ji...@apache.org> on 2023/03/31 14:59:00 UTC

[jira] [Created] (KAFKA-14874) Unable to create > 5000 topics for once when using Kraft

Chia-Ping Tsai created KAFKA-14874:
--------------------------------------

             Summary: Unable to create > 5000 topics for once when using Kraft
                 Key: KAFKA-14874
                 URL: https://issues.apache.org/jira/browse/KAFKA-14874
             Project: Kafka
          Issue Type: Bug
            Reporter: Chia-Ping Tsai
            Assignee: Chia-Ping Tsai


the error happens due to [https://github.com/apache/kafka/blob/trunk/metadata/src/main/java/org/apache/kafka/controller/QuorumController.java#L779]

I encountered this error when creating >5000 topics for mirroring the cluster from zk to Kraft. The operation of creating a bunch of topics is allowed by zk-based kafka.

It seems to me there are two improvements for this issue.

1) add more precise error message for such case.

2) make `maxRecordsPerBatch` configurable (there is already a setter [https://github.com/apache/kafka/blob/trunk/metadata/src/main/java/org/apache/kafka/controller/QuorumController.java#L272])



--
This message was sent by Atlassian Jira
(v8.20.10#820010)