You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@kafka.apache.org by Dhirendra Singh <dh...@gmail.com> on 2020/11/17 16:01:40 UTC

increase in latency with increase in number of partitions per broker

Hi,
I am trying to measure throughput of my 3 broker kafka cluster.
I have created a topic with 3 partitions spread equally over the 3 brokers.
Run a producer application to produce messages. producer application has 3
thread (one for each partition) to produce.
Then i increased the number of partitions in the topic to 6. partitions are
equally distributed among the brokers (2 per broker).
Increased the number of threads in the producer to 6 (one for each
partition).
I expected the throughput to approximately double but what i observed is,
throughput remained same and latency has almost doubled.
Any suggestion/lead why latency has doubled causing the throughput to be
almost same as previous one ?