You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@camel.apache.org by "Omri Tavor (JIRA)" <ji...@apache.org> on 2018/05/08 08:44:00 UTC

[jira] [Created] (CAMEL-12492) Camel kafka producer is blocking

Omri Tavor created CAMEL-12492:
----------------------------------

             Summary: Camel kafka producer is blocking
                 Key: CAMEL-12492
                 URL: https://issues.apache.org/jira/browse/CAMEL-12492
             Project: Camel
          Issue Type: Bug
          Components: camel-kafka
    Affects Versions: 2.21.0
         Environment: Windows/Centos
            Reporter: Omri Tavor


Camel Kafka producer (org.apache.camel.component.kafka.KafkaProducer) is blocking on the Kafka producer (org.apache.kafka.clients.producer.KafkaProducer) callback. This highly affects performance when there is a big latency between the client and the Kafka server. For example, if there is a latency of 100ms between the servers, then the Kafka producer will run at a throughput of 10 events per second (per Camel worker thread). This means that each worker thread will only handle one kafka event at a time resulting in very bad performance.

Changing the 'Process()' method in org.apache.camel.component.kafka.KafkaProducer to always return true (work synchronously) will boost performance on a machine with a latency of 150mb- from 6 events per second to 5000 events per second.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)