[GitHub] [pulsar] lhotari commented on issue #5510: splitting bundle error

[GitBox <gi...@apache.org>]

lhotari commented on issue #5510:
URL: https://github.com/apache/pulsar/issues/5510#issuecomment-725514726


   I'm running into the same issue with a custom build of Pulsar built from v2.6.2-candidate-2 tag (same as v2.6.2).
   In my case, I have a separate namespace with auto topic creation disabled and the application creates topics explicitly. 
   The scenario where this fails creates 7500 topics in 3 minutes at the rate of 25 topics/second. 5 messages are produced in the each created topic and then later on read using a reader (with 25 simultaneous "virtual users").  Things start failing very soon in this scenario. 
   
   The workaround is to [disable bundle auto splitting](https://pulsar.apache.org/docs/en/administration-load-balance/#split-namespace-bundles) and use a reasonable default number of namespace bundles.. 
   ```
   loadBalancerAutoBundleSplitEnabled=false
   defaultNumberOfNamespaceBundles=32
   ```
   With this workaround, Pulsar is able to handle the simple load test in a 3 node cluster (3 zk, 3 bookie, 3 broker).
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org