You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@camel.apache.org by "Claus Ibsen (Jira)" <ji...@apache.org> on 2021/12/02 11:38:00 UTC

[jira] [Resolved] (CAMEL-12492) Camel kafka producer is blocking and processing sequentially

     [ https://issues.apache.org/jira/browse/CAMEL-12492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Claus Ibsen resolved CAMEL-12492.
---------------------------------
    Resolution: Information Provided

> Camel kafka producer is blocking and processing sequentially
> ------------------------------------------------------------
>
>                 Key: CAMEL-12492
>                 URL: https://issues.apache.org/jira/browse/CAMEL-12492
>             Project: Camel
>          Issue Type: Improvement
>          Components: camel-kafka
>    Affects Versions: 2.21.0
>         Environment: Windows/Centos
>            Reporter: Omri Tavor
>            Priority: Major
>
> Camel Kafka producer (org.apache.camel.component.kafka.KafkaProducer) is blocking on the Kafka producer (org.apache.kafka.clients.producer.KafkaProducer) callback. This highly affects performance when there is a big latency between the client and the Kafka server. For example, if there is a latency of 100ms between the servers, then the Kafka producer will run at a throughput of 10 events per second (per Camel worker thread). This means that each worker thread will only handle one kafka event at a time resulting in very bad performance.
> Changing the 'Process()' method in org.apache.camel.component.kafka.KafkaProducer to always return true (work synchronously) will boost performance on a machine with a latency of 150mb- from 6 events per second to 5000 events per second.



--
This message was sent by Atlassian Jira
(v8.20.1#820001)