[GitHub] [pulsar] sijie commented on issue #7058: Pulsar on EBS having poor performance

[GitBox <gi...@apache.org>]

sijie commented on issue #7058:
URL: https://github.com/apache/pulsar/issues/7058#issuecomment-636240424


   @ckdarby 
   
   for reading from backlog:
   
   1) tune rocksdb block cache size for holding the entry index in memory.
   
   ```
   # Size of RocksDB block-cache. For best performance, this cache
   # should be big enough to hold a significant portion of the index
   # database which can reach ~2GB in some cases
   # Default is to use 10% of the direct memory size
   dbStorage_rocksDB_blockCacheSize=
   ```
   
   2) in broker size, increase batch read size.
   
   ```
   dispatcherMaxReadBatchSize
   ```
   
   Then check the io wait metrics on the ledgers directory to see if there is any bottleneck.
   
   If there is bottleneck, try to use multiple directories on ledger disk. This can increase parallelism but you need to make sure you also have multiple partitions. Because the entries of same partition will always go to same ledger directory.
   
   
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org