You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@kafka.apache.org by "kaushik srinivas (JIRA)" <ji...@apache.org> on 2018/11/22 09:41:00 UTC

[jira] [Created] (KAFKA-7667) Need synchronous records send support for kafka performance producer java application.

kaushik srinivas created KAFKA-7667:
---------------------------------------

             Summary: Need synchronous records send support for kafka performance producer java application.
                 Key: KAFKA-7667
                 URL: https://issues.apache.org/jira/browse/KAFKA-7667
             Project: Kafka
          Issue Type: Improvement
          Components: tools
    Affects Versions: 2.0.0
            Reporter: kaushik srinivas
            Assignee: kaushik srinivas


Why synchronous send support for performance producer ?

ProducerPerformance java application is used for load testing kafka brokers.
Load testing involves replicating very high throughput records flowing in to kafka brokers and 
many producers in field would use synchronous way of sending data i.e blocking until the message has been 
written completely on all the min.insyc.replicas no of brokers.

Asynchronous sends would satisfy the first requirement of loading kafka brokers.

This requirement would help in performance tuning the kafka brokers when producers are deployed with "acks": all, "min.insync.replicas" :
equal to replication factor and synchronous way of sending. 
Throughput degradation happens with synchronous producers and this would help in 
tuning resources for replication in kafka brokers. 
Also benchmarks could be made from kafka producer perspective with synchronous way of sending records and tune kafka producer's 
resources appropriately.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)