You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@camel.apache.org by bu...@apache.org on 2016/03/21 20:18:42 UTC
svn commit: r983361 - in /websites/production/camel/content:
cache/main.pageCache kafka.html
Author: buildbot
Date: Mon Mar 21 19:18:41 2016
New Revision: 983361
Log:
Production update by buildbot for camel
Modified:
websites/production/camel/content/cache/main.pageCache
websites/production/camel/content/kafka.html
Modified: websites/production/camel/content/cache/main.pageCache
==============================================================================
Binary files - no diff available.
Modified: websites/production/camel/content/kafka.html
==============================================================================
--- websites/production/camel/content/kafka.html (original)
+++ websites/production/camel/content/kafka.html Mon Mar 21 19:18:41 2016
@@ -93,7 +93,7 @@
<!-- use the same version as your Camel core version -->
</dependency>
]]></script>
-</div></div><h4 id="Kafka-Camel2.17ornewer">Camel 2.17 or newer</h4><p>Scala is not longer used, as we use the kafka java client.</p><h4 id="Kafka-Camel2.16orolder">Camel 2.16 or older</h4><p>And then the Scala libraries of choice. camel-kafka does not include that dependency, but assume its provided. For example to use Scala 2.10.4 add:</p><div class="code panel pdl" style="border-width: 1px;"><div class="codeContent panelContent pdl">
+</div></div><h4 id="Kafka-Camel2.17ornewer">Camel 2.17 or newer</h4><p>Scala is no longer used, as we use the kafka java client.</p><h4 id="Kafka-Camel2.16orolder">Camel 2.16 or older</h4><p>And then the Scala libraries of choice. camel-kafka does not include that dependency, but assume its provided. For example to use Scala 2.10.4 add:</p><div class="code panel pdl" style="border-width: 1px;"><div class="codeContent panelContent pdl">
<script class="brush: xml; gutter: false; theme: Default" type="syntaxhighlighter"><![CDATA[ <dependency>
<groupId>org.scala-lang</groupId>
<artifactId>scala-library</artifactId>
@@ -102,10 +102,48 @@
</div></div><h3 id="Kafka-URIformat">URI format</h3><div class="code panel pdl" style="border-width: 1px;"><div class="codeContent panelContent pdl">
<script class="brush: java; gutter: false; theme: Default" type="syntaxhighlighter"><![CDATA[kafka:server:port[?options]
]]></script>
-</div></div><p> </p><h3 id="Kafka-Options(Camel2.16orolder)">Options (Camel 2.16 or older)</h3><div class="confluenceTableSmall"><div class="table-wrap"><table class="confluenceTable"><tbody><tr><th colspan="1" rowspan="1" class="confluenceTh"><p>Property</p></th><th colspan="1" rowspan="1" class="confluenceTh"><p>Default</p></th><th colspan="1" rowspan="1" class="confluenceTh"><p>Description</p></th></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>zookeeperHost</p></td><td colspan="1" rowspan="1" class="confluenceTd"><p> </p></td><td colspan="1" rowspan="1" class="confluenceTd"><p>The zookeeper host to use</p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>zookeeperPort</p></td><td colspan="1" rowspan="1" class="confluenceTd"><p>2181</p></td><td colspan="1" rowspan="1" class="confluenceTd"><p>The zookeeper port to use</p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd">zookeeperConnect</td><td colspan="1" rowspan="1" class="conf
luenceTd"> </td><td colspan="1" rowspan="1" class="confluenceTd"><strong>Camel 2.13.3/2.14.1:</strong> If in use, then zookeeperHost/zookeeperPort is not used.</td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>topic</p></td><td colspan="1" rowspan="1" class="confluenceTd"><p> </p></td><td colspan="1" rowspan="1" class="confluenceTd"><p>The topic to use</p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>groupId</p></td><td colspan="1" rowspan="1" class="confluenceTd"> </td><td colspan="1" rowspan="1" class="confluenceTd"> </td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>partitioner</p></td><td colspan="1" rowspan="1" class="confluenceTd"> </td><td colspan="1" rowspan="1" class="confluenceTd"> </td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>consumerStreams</p></td><td colspan="1" rowspan="1" class="confluenceTd">10</td><td colspan="1" rowspan="1" class="confluenceTd"> </td></tr><tr><
td colspan="1" rowspan="1" class="confluenceTd"><p>clientId</p></td><td colspan="1" rowspan="1" class="confluenceTd"> </td><td colspan="1" rowspan="1" class="confluenceTd"> </td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>zookeeperSessionTimeoutMs</p></td><td colspan="1" rowspan="1" class="confluenceTd"> </td><td colspan="1" rowspan="1" class="confluenceTd"> </td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>zookeeperConnectionTimeoutMs</p></td><td colspan="1" rowspan="1" class="confluenceTd"> </td><td colspan="1" rowspan="1" class="confluenceTd"> </td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>zookeeperSyncTimeMs</p></td><td colspan="1" rowspan="1" class="confluenceTd"> </td><td colspan="1" rowspan="1" class="confluenceTd"> </td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p><span style="color: rgb(51,51,51);">consumersCount</span></p></td><td colspan="1" rowspan="1" class="confl
uenceTd"><p><span style="color: rgb(51,51,51);">1</span></p></td><td colspan="1" rowspan="1" class="confluenceTd"><p><strong>Camel 2.15.0:</strong> The number of consumers that connect to kafka server</p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p><span style="color: rgb(51,51,51);">batchSize</span></p></td><td colspan="1" rowspan="1" class="confluenceTd"><p><span style="color: rgb(51,51,51);">100</span></p></td><td colspan="1" rowspan="1" class="confluenceTd"><p><strong>Camel 2.15.0: </strong>The batchSize that the BatchingConsumerTask processes once.<strong><br clear="none"></strong></p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p><span style="color: rgb(51,51,51);">barrierAwaitTimeoutMs</span></p></td><td colspan="1" rowspan="1" class="confluenceTd"><p><span style="color: rgb(51,51,51);">10000</span></p></td><td colspan="1" rowspan="1" class="confluenceTd"><p><strong>Camel 2.15.0: </strong>If the BatchingConsumerTask processes exchange e
xceed the batchSize, it will wait for <span style="color: rgb(51,51,51);">barrierAwaitTimeoutMs</span>.<strong><br clear="none"></strong></p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd">bridgeEndpoint</td><td colspan="1" rowspan="1" class="confluenceTd">false</td><td colspan="1" rowspan="1" class="confluenceTd">Camel 2.16.0: If the bridgeEndpoint is true, the producer will ignore the topic header setting of the message.</td></tr></tbody></table></div></div><p>You can append query options to the URI in the following format, <code>?option=value&option=value&...</code></p><h3 id="Kafka-ProducerOptions(Camel2.16orolder)">Producer Options (Camel 2.16 or older)</h3><div class="confluenceTableSmall"><div class="table-wrap"><table class="confluenceTable"><tbody><tr><th colspan="1" rowspan="1" class="confluenceTh"><p>Property</p></th><th colspan="1" rowspan="1" class="confluenceTh"><p>Default</p></th><th colspan="1" rowspan="1" class="confluenceTh"><p>Descripti
on</p></th></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>producerType</p></td><td colspan="1" rowspan="1" class="confluenceTd"><p>sync (Taken from native KafkaProducer class)</p></td><td colspan="1" rowspan="1" class="confluenceTd"><p>sync - send message/batch immediately, and wait until response is received</p><p>async - queue the message/batch to send. There is a thread per broker (Kafka node) which polls from this queue upon <span>queueBufferingMaxMs or <span>batchNumMessages</span></span></p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd">compressionCodec</td><td colspan="1" rowspan="1" class="confluenceTd"> </td><td colspan="1" rowspan="1" class="confluenceTd"> </td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd">compressedTopics</td><td colspan="1" rowspan="1" class="confluenceTd"> </td><td colspan="1" rowspan="1" class="confluenceTd"> </td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd">messageSendMaxRetrie
s</td><td colspan="1" rowspan="1" class="confluenceTd"> </td><td colspan="1" rowspan="1" class="confluenceTd"> </td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd">retryBackoffMs</td><td colspan="1" rowspan="1" class="confluenceTd"> </td><td colspan="1" rowspan="1" class="confluenceTd"> </td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd">topicMetadataRefreshIntervalMs</td><td colspan="1" rowspan="1" class="confluenceTd"> </td><td colspan="1" rowspan="1" class="confluenceTd"> </td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd">sendBufferBytes</td><td colspan="1" rowspan="1" class="confluenceTd"> </td><td colspan="1" rowspan="1" class="confluenceTd"> </td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd">requestRequiredAcks</td><td colspan="1" rowspan="1" class="confluenceTd"> </td><td colspan="1" rowspan="1" class="confluenceTd"> </td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd">req
uestTimeoutMs</td><td colspan="1" rowspan="1" class="confluenceTd"> </td><td colspan="1" rowspan="1" class="confluenceTd"> </td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd">queueBufferingMaxMs</td><td colspan="1" rowspan="1" class="confluenceTd"> </td><td colspan="1" rowspan="1" class="confluenceTd"> </td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd">queueBufferingMaxMessages</td><td colspan="1" rowspan="1" class="confluenceTd"> </td><td colspan="1" rowspan="1" class="confluenceTd"> </td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd">queueEnqueueTimeoutMs</td><td colspan="1" rowspan="1" class="confluenceTd"> </td><td colspan="1" rowspan="1" class="confluenceTd"> </td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd">batchNumMessages</td><td colspan="1" rowspan="1" class="confluenceTd"> </td><td colspan="1" rowspan="1" class="confluenceTd"> </td></tr><tr><td colspan="1" rowspan="1" class="co
nfluenceTd">serializerClass</td><td colspan="1" rowspan="1" class="confluenceTd"> </td><td colspan="1" rowspan="1" class="confluenceTd"> </td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd">keySerializerClass</td><td colspan="1" rowspan="1" class="confluenceTd"> </td><td colspan="1" rowspan="1" class="confluenceTd"> </td></tr></tbody></table></div></div><h3 id="Kafka-ConsumerOptions(Camel2.16orolder)">Consumer Options (Camel 2.16 or older)</h3><div class="confluenceTableSmall"><div class="table-wrap"><table class="confluenceTable"><tbody><tr><th colspan="1" rowspan="1" class="confluenceTh"><p>Property</p></th><th colspan="1" rowspan="1" class="confluenceTh"><p>Default</p></th><th colspan="1" rowspan="1" class="confluenceTh"><p>Description</p></th></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>consumerId</p></td><td colspan="1" rowspan="1" class="confluenceTd"><p> </p></td><td colspan="1" rowspan="1" class="confluenceTd"> </t
d></tr><tr><td colspan="1" rowspan="1" class="confluenceTd">socketTimeoutMs</td><td colspan="1" rowspan="1" class="confluenceTd"> </td><td colspan="1" rowspan="1" class="confluenceTd"> </td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd">socketReceiveBufferBytes</td><td colspan="1" rowspan="1" class="confluenceTd"> </td><td colspan="1" rowspan="1" class="confluenceTd"> </td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd">fetchMessageMaxBytes</td><td colspan="1" rowspan="1" class="confluenceTd"> </td><td colspan="1" rowspan="1" class="confluenceTd"> </td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd">autoCommitEnable</td><td colspan="1" rowspan="1" class="confluenceTd"> </td><td colspan="1" rowspan="1" class="confluenceTd"> </td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd">autoCommitIntervalMs</td><td colspan="1" rowspan="1" class="confluenceTd"> </td><td colspan="1" rowspan="1" class="confluence
Td"> </td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd">queuedMaxMessages</td><td colspan="1" rowspan="1" class="confluenceTd"> </td><td colspan="1" rowspan="1" class="confluenceTd"> </td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd">rebalanceMaxRetries</td><td colspan="1" rowspan="1" class="confluenceTd"> </td><td colspan="1" rowspan="1" class="confluenceTd"> </td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd">fetchMinBytes</td><td colspan="1" rowspan="1" class="confluenceTd"> </td><td colspan="1" rowspan="1" class="confluenceTd"> </td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd">fetchWaitMaxMs</td><td colspan="1" rowspan="1" class="confluenceTd"> </td><td colspan="1" rowspan="1" class="confluenceTd"> </td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd">rebalanceBackoffMs</td><td colspan="1" rowspan="1" class="confluenceTd"> </td><td colspan="1" rowspan="1" class="confluenceT
d"> </td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd">refreshLeaderBackoffMs</td><td colspan="1" rowspan="1" class="confluenceTd"> </td><td colspan="1" rowspan="1" class="confluenceTd"> </td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd">autoOffsetReset</td><td colspan="1" rowspan="1" class="confluenceTd"> </td><td colspan="1" rowspan="1" class="confluenceTd"> </td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd">consumerTimeoutMs</td><td colspan="1" rowspan="1" class="confluenceTd"> </td><td colspan="1" rowspan="1" class="confluenceTd"> </td></tr></tbody></table></div></div><h3 id="Kafka-Options(Camel2.17ornewer)">Options (Camel 2.17 or newer)</h3><div class="table-wrap"><table class="confluenceTable"><tbody><tr><th colspan="1" rowspan="1" class="confluenceTh">Property</th><th colspan="1" rowspan="1" class="confluenceTh">Default</th><th colspan="1" rowspan="1" class="confluenceTh">Description</th></tr><tr><td colsp
an="1" rowspan="1" class="confluenceTd"><p class="p1"><span class="s1">topic</span></p></td><td colspan="1" rowspan="1" class="confluenceTd"> </td><td colspan="1" rowspan="1" class="confluenceTd">Topic to use</td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p class="p1"><span class="s1">groupId</span></p></td><td colspan="1" rowspan="1" class="confluenceTd"> </td><td colspan="1" rowspan="1" class="confluenceTd"> </td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p class="p1"><span class="s1">consumerStreams</span></p></td><td colspan="1" rowspan="1" class="confluenceTd">10</td><td colspan="1" rowspan="1" class="confluenceTd"> </td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p class="p1"><span class="s1">clientId</span></p></td><td colspan="1" rowspan="1" class="confluenceTd"> </td><td colspan="1" rowspan="1" class="confluenceTd"> </td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p class="p1"><span
class="s1">consumersCount</span></p></td><td colspan="1" rowspan="1" class="confluenceTd">1</td><td colspan="1" rowspan="1" class="confluenceTd"><p class="p1"><span class="s1">The number of consumers that connect to kafka server</span></p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p class="p1"><span class="s1">batchSize</span></p></td><td colspan="1" rowspan="1" class="confluenceTd">100</td><td colspan="1" rowspan="1" class="confluenceTd"><p class="p1"><span class="s1">Commit Size if auto commit is false</span></p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p class="p1"><span class="s1">bridgeEndpoint</span></p></td><td colspan="1" rowspan="1" class="confluenceTd">false</td><td colspan="1" rowspan="1" class="confluenceTd"><span>Camel 2.16.0: If the bridgeEndpoint is true, the producer will ignore the topic header setting of the message.</span></td></tr></tbody></table></div><p> </p><h3 id="Kafka-ProducerOptions(Camel2.17ornewer)">Produce
r Options (Camel 2.17 or newer)</h3><div class="table-wrap"><table class="confluenceTable"><tbody><tr><th colspan="1" rowspan="1" class="confluenceTh">Property</th><th colspan="1" rowspan="1" class="confluenceTh">Default & Description Reference</th></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>keyDeserializer</p></td><td colspan="1" rowspan="46" class="confluenceTd"><p class="p1"><span class="s1"><span class="nolink">http://kafka.apache.org/documentation.html#producerconfigs</span></span></p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>keyDeserializer</p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>requestRequiredAcks </p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>bufferMemorySize </p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>compressionCodec </p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>retries </p></td></tr><tr><td colspan="1"
rowspan="1" class="confluenceTd"><p>sslKeyPassword</p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>sslKeystoreLocation</p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>sslKeystorePassword</p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>sslTruststoreLocation</p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>sslTruststorePassword</p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>producerBatchSize </p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>clientId</p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>connectionMaxIdleMs </p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>lingerMs </p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>maxBlockMs </p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>maxRequestSize </p></td></tr><tr><td colspan="1" rowspan="1" class="conflue
nceTd"><p>partitioner </p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>receiveBufferBytes </p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>requestTimeoutMs </p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>saslKerberosServiceName</p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>securityProtocol</p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>sendBufferBytes </p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>sslEnabledProtocols </p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>sslKeystoreType </p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>sslProtocol </p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>sslProvider</p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>sslTruststoreType</p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>tim
eoutMs </p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>blockOnBufferFull </p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>maxInFlightRequest </p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>metadataFetchTimeoutMs </p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>metadataMaxAgeMs </p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>metricReporters</p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>noOfMetricsSample </p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>metricsSampleWindowMs </p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>reconnectBackoffMs </p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>retryBackoffMs </p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>kerberosInitCmd </p></td></tr><tr><td colspan="1" rowspan="1" class="confl
uenceTd"><p>kerberosBeforeReloginMinTime </p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>kerberosRenewJitter </p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>kerberosRenewWindowFactor </p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>sslCipherSuites</p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>sslEndpointAlgorithm</p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>sslKeymanagerAlgorithm </p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>sslTrustmanagerAlgorithm </p></td></tr></tbody></table></div><h3 id="Kafka-ConsumerOptions(Camel2.17ornewer)">Consumer Options (Camel 2.17 or newer)</h3><div class="table-wrap"><table class="confluenceTable"><tbody><tr><th colspan="1" rowspan="1" class="confluenceTh">Property</th><th colspan="1" rowspan="1" class="confluenceTh">Default & Description Reference</th></tr><tr><td colspan="1" rowspan
="1" class="confluenceTd"><p>bootstrapServers</p></td><td colspan="1" rowspan="45" class="confluenceTd"><p class="p1"><span class="s1"><span class="nolink">http://kafka.apache.org/documentation.html#newconsumerconfigs</span></span></p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>keyDeserializer</p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>valueDeserializer</p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>fetchMinBytes </p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>groupId</p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>heartbeatIntervalMs </p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>maxPartitionFetchBytes </p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>sessionTimeoutMs </p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>sslKeyPassword</p></td></tr><tr><td colspan="1" rowspan="1" class="conflu
enceTd"><p>sslKeystoreLocation</p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>sslKeystorePassword</p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>sslTruststoreLocation</p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>sslTruststorePassword</p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>autoOffsetReset </p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>connectionMaxIdleMs </p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>autoCommitEnable </p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>partitionAssignor </p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>receiveBufferBytes </p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>consumerRequestTimeoutMs </p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>saslKerberosServiceName</p></td></tr><tr><td colspan="1" rows
pan="1" class="confluenceTd"><p>securityProtocol</p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>sendBufferBytes </p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>sslEnabledProtocols </p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>sslKeystoreType </p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>sslProtocol </p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>sslProvider</p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>sslTruststoreType</p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>autoCommitIntervalMs </p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>checkCrcs </p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>clientId</p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>fetchWaitMaxMs </p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><
p>metadataMaxAgeMs </p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>metricReporters</p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>noOfMetricsSample </p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>metricsSampleWindowMs </p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>reconnectBackoffMs </p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>retryBackoffMs </p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>kerberosInitCmd </p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>kerberosBeforeReloginMinTime </p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>kerberosRenewJitter </p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>kerberosRenewWindowFactor </p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>sslCipherSuites</p></td></tr><tr><td colspan="1" rows
pan="1" class="confluenceTd"><p>sslEndpointAlgorithm</p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>sslKeymanagerAlgorithm </p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>sslTrustmanagerAlgorithm </p></td></tr></tbody></table></div><p> </p><h3 id="Kafka-Samples">Samples</h3><h4 id="Kafka-Camel2.16orolder.1">Camel 2.16 or older</h4><p>Consuming messages:</p><div class="code panel pdl" style="border-width: 1px;"><div class="codeContent panelContent pdl">
+</div></div><p> </p><h3 id="Kafka-Options(Camel2.16orolder)">Options (Camel 2.16 or older)</h3><div class="confluenceTableSmall"><div class="table-wrap"><table class="confluenceTable"><tbody><tr><th colspan="1" rowspan="1" class="confluenceTh"><p>Property</p></th><th colspan="1" rowspan="1" class="confluenceTh"><p>Default</p></th><th colspan="1" rowspan="1" class="confluenceTh"><p>Description</p></th></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>zookeeperHost</p></td><td colspan="1" rowspan="1" class="confluenceTd"><p> </p></td><td colspan="1" rowspan="1" class="confluenceTd"><p>The zookeeper host to use</p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>zookeeperPort</p></td><td colspan="1" rowspan="1" class="confluenceTd"><p>2181</p></td><td colspan="1" rowspan="1" class="confluenceTd"><p>The zookeeper port to use</p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd">zookeeperConnect</td><td colspan="1" rowspan="1" class="conf
luenceTd"> </td><td colspan="1" rowspan="1" class="confluenceTd"><strong>Camel 2.13.3/2.14.1:</strong> If in use, then zookeeperHost/zookeeperPort is not used.</td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>topic</p></td><td colspan="1" rowspan="1" class="confluenceTd"><p> </p></td><td colspan="1" rowspan="1" class="confluenceTd"><p>The topic to use</p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>groupId</p></td><td colspan="1" rowspan="1" class="confluenceTd"> </td><td colspan="1" rowspan="1" class="confluenceTd"> </td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>partitioner</p></td><td colspan="1" rowspan="1" class="confluenceTd"> </td><td colspan="1" rowspan="1" class="confluenceTd"> </td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>consumerStreams</p></td><td colspan="1" rowspan="1" class="confluenceTd">10</td><td colspan="1" rowspan="1" class="confluenceTd"> </td></tr><tr><
td colspan="1" rowspan="1" class="confluenceTd"><p>clientId</p></td><td colspan="1" rowspan="1" class="confluenceTd"> </td><td colspan="1" rowspan="1" class="confluenceTd"> </td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>zookeeperSessionTimeoutMs</p></td><td colspan="1" rowspan="1" class="confluenceTd"> </td><td colspan="1" rowspan="1" class="confluenceTd"> </td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>zookeeperConnectionTimeoutMs</p></td><td colspan="1" rowspan="1" class="confluenceTd"> </td><td colspan="1" rowspan="1" class="confluenceTd"> </td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>zookeeperSyncTimeMs</p></td><td colspan="1" rowspan="1" class="confluenceTd"> </td><td colspan="1" rowspan="1" class="confluenceTd"> </td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p><span style="color: rgb(51,51,51);">consumersCount</span></p></td><td colspan="1" rowspan="1" class="confl
uenceTd"><p><span style="color: rgb(51,51,51);">1</span></p></td><td colspan="1" rowspan="1" class="confluenceTd"><p><strong>Camel 2.15.0:</strong> The number of consumers that connect to kafka server</p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p><span style="color: rgb(51,51,51);">batchSize</span></p></td><td colspan="1" rowspan="1" class="confluenceTd"><p><span style="color: rgb(51,51,51);">100</span></p></td><td colspan="1" rowspan="1" class="confluenceTd"><p><strong>Camel 2.15.0: </strong>The batchSize that the BatchingConsumerTask processes once.<strong><br clear="none"></strong></p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p><span style="color: rgb(51,51,51);">barrierAwaitTimeoutMs</span></p></td><td colspan="1" rowspan="1" class="confluenceTd"><p><span style="color: rgb(51,51,51);">10000</span></p></td><td colspan="1" rowspan="1" class="confluenceTd"><p><strong>Camel 2.15.0: </strong>If the BatchingConsumerTask processes exchange e
xceed the batchSize, it will wait for <span style="color: rgb(51,51,51);">barrierAwaitTimeoutMs</span>.<strong><br clear="none"></strong></p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd">bridgeEndpoint</td><td colspan="1" rowspan="1" class="confluenceTd">false</td><td colspan="1" rowspan="1" class="confluenceTd">Camel 2.16.0: If the bridgeEndpoint is true, the producer will ignore the topic header setting of the message.</td></tr></tbody></table></div></div><p>You can append query options to the URI in the following format, <code>?option=value&option=value&...</code></p><h3 id="Kafka-ProducerOptions(Camel2.16orolder)">Producer Options (Camel 2.16 or older)</h3><div class="confluenceTableSmall"><div class="table-wrap"><table class="confluenceTable"><tbody><tr><th colspan="1" rowspan="1" class="confluenceTh"><p>Property</p></th><th colspan="1" rowspan="1" class="confluenceTh"><p>Default</p></th><th colspan="1" rowspan="1" class="confluenceTh"><p>Descripti
on</p></th></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>producerType</p></td><td colspan="1" rowspan="1" class="confluenceTd"><p>sync (Taken from native KafkaProducer class)</p></td><td colspan="1" rowspan="1" class="confluenceTd"><p>sync - send message/batch immediately, and wait until response is received</p><p>async - queue the message/batch to send. There is a thread per broker (Kafka node) which polls from this queue upon <span>queueBufferingMaxMs or <span>batchNumMessages</span></span></p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd">compressionCodec</td><td colspan="1" rowspan="1" class="confluenceTd"> </td><td colspan="1" rowspan="1" class="confluenceTd"> </td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd">compressedTopics</td><td colspan="1" rowspan="1" class="confluenceTd"> </td><td colspan="1" rowspan="1" class="confluenceTd"> </td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd">messageSendMaxRetrie
s</td><td colspan="1" rowspan="1" class="confluenceTd"> </td><td colspan="1" rowspan="1" class="confluenceTd"> </td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd">retryBackoffMs</td><td colspan="1" rowspan="1" class="confluenceTd"> </td><td colspan="1" rowspan="1" class="confluenceTd"> </td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd">topicMetadataRefreshIntervalMs</td><td colspan="1" rowspan="1" class="confluenceTd"> </td><td colspan="1" rowspan="1" class="confluenceTd"> </td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd">sendBufferBytes</td><td colspan="1" rowspan="1" class="confluenceTd"> </td><td colspan="1" rowspan="1" class="confluenceTd"> </td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd">requestRequiredAcks</td><td colspan="1" rowspan="1" class="confluenceTd"> </td><td colspan="1" rowspan="1" class="confluenceTd"> </td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd">req
uestTimeoutMs</td><td colspan="1" rowspan="1" class="confluenceTd"> </td><td colspan="1" rowspan="1" class="confluenceTd"> </td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd">queueBufferingMaxMs</td><td colspan="1" rowspan="1" class="confluenceTd"> </td><td colspan="1" rowspan="1" class="confluenceTd"> </td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd">queueBufferingMaxMessages</td><td colspan="1" rowspan="1" class="confluenceTd"> </td><td colspan="1" rowspan="1" class="confluenceTd"> </td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd">queueEnqueueTimeoutMs</td><td colspan="1" rowspan="1" class="confluenceTd"> </td><td colspan="1" rowspan="1" class="confluenceTd"> </td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd">batchNumMessages</td><td colspan="1" rowspan="1" class="confluenceTd"> </td><td colspan="1" rowspan="1" class="confluenceTd"> </td></tr><tr><td colspan="1" rowspan="1" class="co
nfluenceTd">serializerClass</td><td colspan="1" rowspan="1" class="confluenceTd"> </td><td colspan="1" rowspan="1" class="confluenceTd"> </td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd">keySerializerClass</td><td colspan="1" rowspan="1" class="confluenceTd"> </td><td colspan="1" rowspan="1" class="confluenceTd"> </td></tr></tbody></table></div></div><h3 id="Kafka-ConsumerOptions(Camel2.16orolder)">Consumer Options (Camel 2.16 or older)</h3><div class="confluenceTableSmall"><div class="table-wrap"><table class="confluenceTable"><tbody><tr><th colspan="1" rowspan="1" class="confluenceTh"><p>Property</p></th><th colspan="1" rowspan="1" class="confluenceTh"><p>Default</p></th><th colspan="1" rowspan="1" class="confluenceTh"><p>Description</p></th></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>consumerId</p></td><td colspan="1" rowspan="1" class="confluenceTd"><p> </p></td><td colspan="1" rowspan="1" class="confluenceTd"> </t
d></tr><tr><td colspan="1" rowspan="1" class="confluenceTd">socketTimeoutMs</td><td colspan="1" rowspan="1" class="confluenceTd"> </td><td colspan="1" rowspan="1" class="confluenceTd"> </td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd">socketReceiveBufferBytes</td><td colspan="1" rowspan="1" class="confluenceTd"> </td><td colspan="1" rowspan="1" class="confluenceTd"> </td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd">fetchMessageMaxBytes</td><td colspan="1" rowspan="1" class="confluenceTd"> </td><td colspan="1" rowspan="1" class="confluenceTd"> </td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd">autoCommitEnable</td><td colspan="1" rowspan="1" class="confluenceTd"> </td><td colspan="1" rowspan="1" class="confluenceTd"> </td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd">autoCommitIntervalMs</td><td colspan="1" rowspan="1" class="confluenceTd"> </td><td colspan="1" rowspan="1" class="confluence
Td"> </td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd">queuedMaxMessages</td><td colspan="1" rowspan="1" class="confluenceTd"> </td><td colspan="1" rowspan="1" class="confluenceTd"> </td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd">rebalanceMaxRetries</td><td colspan="1" rowspan="1" class="confluenceTd"> </td><td colspan="1" rowspan="1" class="confluenceTd"> </td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd">fetchMinBytes</td><td colspan="1" rowspan="1" class="confluenceTd"> </td><td colspan="1" rowspan="1" class="confluenceTd"> </td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd">fetchWaitMaxMs</td><td colspan="1" rowspan="1" class="confluenceTd"> </td><td colspan="1" rowspan="1" class="confluenceTd"> </td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd">rebalanceBackoffMs</td><td colspan="1" rowspan="1" class="confluenceTd"> </td><td colspan="1" rowspan="1" class="confluenceT
d"> </td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd">refreshLeaderBackoffMs</td><td colspan="1" rowspan="1" class="confluenceTd"> </td><td colspan="1" rowspan="1" class="confluenceTd"> </td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd">autoOffsetReset</td><td colspan="1" rowspan="1" class="confluenceTd"> </td><td colspan="1" rowspan="1" class="confluenceTd"> </td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd">consumerTimeoutMs</td><td colspan="1" rowspan="1" class="confluenceTd"> </td><td colspan="1" rowspan="1" class="confluenceTd"> </td></tr></tbody></table></div></div><h3 id="Kafka-Options(Camel2.17ornewer)">Options (Camel 2.17 or newer)</h3><div class="table-wrap"><table class="confluenceTable"><tbody><tr><th colspan="1" rowspan="1" class="confluenceTh">Property</th><th colspan="1" rowspan="1" class="confluenceTh">Default</th><th colspan="1" rowspan="1" class="confluenceTh">Description</th></tr><tr><td colsp
an="1" rowspan="1" class="confluenceTd"><p class="p1"><span class="s1">topic</span></p></td><td colspan="1" rowspan="1" class="confluenceTd"> </td><td colspan="1" rowspan="1" class="confluenceTd">Topic to use</td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p class="p1"><span class="s1">groupId</span></p></td><td colspan="1" rowspan="1" class="confluenceTd"> </td><td colspan="1" rowspan="1" class="confluenceTd"> </td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p class="p1"><span class="s1">consumerStreams</span></p></td><td colspan="1" rowspan="1" class="confluenceTd">10</td><td colspan="1" rowspan="1" class="confluenceTd"> </td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p class="p1"><span class="s1">clientId</span></p></td><td colspan="1" rowspan="1" class="confluenceTd"> </td><td colspan="1" rowspan="1" class="confluenceTd"> </td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p class="p1"><span
class="s1">consumersCount</span></p></td><td colspan="1" rowspan="1" class="confluenceTd">1</td><td colspan="1" rowspan="1" class="confluenceTd"><p class="p1"><span class="s1">The number of consumers that connect to kafka server</span></p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p class="p1"><span class="s1">batchSize</span></p></td><td colspan="1" rowspan="1" class="confluenceTd">100</td><td colspan="1" rowspan="1" class="confluenceTd"><p class="p1"><span class="s1">Commit Size if auto commit is false</span></p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p class="p1"><span class="s1">bridgeEndpoint</span></p></td><td colspan="1" rowspan="1" class="confluenceTd">false</td><td colspan="1" rowspan="1" class="confluenceTd"><span>Camel 2.16.0: If the bridgeEndpoint is true, the producer will ignore the topic header setting of the message.</span></td></tr></tbody></table></div><p> </p><h3 id="Kafka-ProducerOptions(Camel2.17ornewer)">Produce
r Options (Camel 2.17 or newer)</h3><div class="table-wrap"><table class="confluenceTable"><tbody><tr><th colspan="1" rowspan="1" class="confluenceTh">Property</th><th colspan="1" rowspan="1" class="confluenceTh">Default & Description Reference</th></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>keyDeserializer</p></td><td colspan="1" rowspan="46" class="confluenceTd"><p class="p1"><span class="s1"><span class="nolink">http://kafka.apache.org/documentation.html#producerconfigs</span></span></p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>keyDeserializer</p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>requestRequiredAcks </p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>bufferMemorySize </p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>compressionCodec </p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>retries </p></td></tr><tr><td colspan="1"
rowspan="1" class="confluenceTd"><p>sslKeyPassword</p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>sslKeystoreLocation</p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>sslKeystorePassword</p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>sslTruststoreLocation</p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>sslTruststorePassword</p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>producerBatchSize </p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>clientId</p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>connectionMaxIdleMs </p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>lingerMs </p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>maxBlockMs </p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>maxRequestSize </p></td></tr><tr><td colspan="1" rowspan="1" class="conflue
nceTd"><p>partitioner </p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>receiveBufferBytes </p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>requestTimeoutMs </p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>saslKerberosServiceName</p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>securityProtocol</p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>sendBufferBytes </p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>sslEnabledProtocols </p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>sslKeystoreType </p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>sslProtocol </p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>sslProvider</p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>sslTruststoreType</p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>tim
eoutMs </p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>blockOnBufferFull </p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>maxInFlightRequest </p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>metadataFetchTimeoutMs </p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>metadataMaxAgeMs </p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>metricReporters</p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>noOfMetricsSample </p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>metricsSampleWindowMs </p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>reconnectBackoffMs </p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>retryBackoffMs </p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>kerberosInitCmd </p></td></tr><tr><td colspan="1" rowspan="1" class="confl
uenceTd"><p>kerberosBeforeReloginMinTime </p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>kerberosRenewJitter </p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>kerberosRenewWindowFactor </p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>sslCipherSuites</p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>sslEndpointAlgorithm</p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>sslKeymanagerAlgorithm </p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>sslTrustmanagerAlgorithm </p></td></tr></tbody></table></div><h3 id="Kafka-ConsumerOptions(Camel2.17ornewer)">Consumer Options (Camel 2.17 or newer)</h3><div class="table-wrap"><table class="confluenceTable"><tbody><tr><th colspan="1" rowspan="1" class="confluenceTh">Property</th><th colspan="1" rowspan="1" class="confluenceTh">Default & Description Reference</th></tr><tr><td colspan="1" rowspan
="1" class="confluenceTd"><p> </p></td><td colspan="1" rowspan="45" class="confluenceTd"><p class="p1"><span class="s1"><span class="nolink">http://kafka.apache.org/documentation.html#newconsumerconfigs</span></span></p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>keyDeserializer</p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>valueDeserializer</p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>fetchMinBytes </p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>groupId</p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>heartbeatIntervalMs </p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>maxPartitionFetchBytes </p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>sessionTimeoutMs </p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>sslKeyPassword</p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p
>sslKeystoreLocation</p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>sslKeystorePassword</p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>sslTruststoreLocation</p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>sslTruststorePassword</p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>autoOffsetReset </p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>connectionMaxIdleMs </p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>autoCommitEnable </p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>partitionAssignor </p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>receiveBufferBytes </p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>consumerRequestTimeoutMs </p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>saslKerberosServiceName</p></td></tr><tr><td colspan="1" rowspan="1" cl
ass="confluenceTd"><p>securityProtocol</p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>sendBufferBytes </p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>sslEnabledProtocols </p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>sslKeystoreType </p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>sslProtocol </p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>sslProvider</p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>sslTruststoreType</p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>autoCommitIntervalMs </p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>checkCrcs </p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>clientId</p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>fetchWaitMaxMs </p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>metadata
MaxAgeMs </p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>metricReporters</p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>noOfMetricsSample </p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>metricsSampleWindowMs </p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>reconnectBackoffMs </p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>retryBackoffMs </p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>kerberosInitCmd </p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>kerberosBeforeReloginMinTime </p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>kerberosRenewJitter </p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>kerberosRenewWindowFactor </p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>sslCipherSuites</p></td></tr><tr><td colspan="1" rowspan="1" cl
ass="confluenceTd"><p>sslEndpointAlgorithm</p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>sslKeymanagerAlgorithm </p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>sslTrustmanagerAlgorithm </p></td></tr></tbody></table></div><p> </p><h3 id="Kafka-Samples">Samples</h3><h4 id="Kafka-Camel2.16orolder.1">Camel 2.16 or older</h4><p>Consuming messages:</p><div class="code panel pdl" style="border-width: 1px;"><div class="codeContent panelContent pdl">
<script class="brush: java; gutter: false; theme: Default" type="syntaxhighlighter"><![CDATA[from("kafka:localhost:9092?topic=test&zookeeperHost=localhost&zookeeperPort=2181&groupId=group1").to("log:input");
]]></script>
-</div></div><p>Producing messages:</p><p>See unit tests of camel-kafka for more examples</p><p></p><h2 id="Kafka-Endpoints">Endpoints</h2>
+</div></div><p>Producing messages:</p><p>See unit tests of camel-kafka for more examples</p><h4 id="Kafka-Camel2.17ornewer.1">Camel 2.17 or newer</h4><p>Consuming messages:</p><div class="code panel pdl" style="border-width: 1px;"><div class="codeContent panelContent pdl">
+<script class="brush: java; gutter: false; theme: Default" type="syntaxhighlighter"><![CDATA[from("kafka:localhost:9092?topic=test&groupId=testing&autoOffsetReset=earliest&consumersCount=1")
+ .process(new Processor() {
+ @Override
+ public void process(Exchange exchange)
+ throws Exception {
+ String messageKey = "";
+ if (exchange.getIn() != null) {
+ Message message = exchange.getIn();
+ Integer partitionId = (Integer) message
+ .getHeader(KafkaConstants.PARTITION);
+ String topicName = (String) message
+ .getHeader(KafkaConstants.TOPIC);
+ if (message.getHeader(KafkaConstants.KEY) != null)
+ messageKey = (String) message
+ .getHeader(KafkaConstants.KEY);
+ Object data = message.getBody();
+
+
+ System.out.println("topicName :: "
+ + topicName + " partitionId :: "
+ + partitionId + " messageKey :: "
+ + messageKey + " message :: "
+ + data + "\n");
+ }
+ }
+ }).to("log:input");
+]]></script>
+</div></div><p> </p><p>Producing messages:</p><div class="code panel pdl" style="border-width: 1px;"><div class="codeContent panelContent pdl">
+<script class="brush: java; gutter: false; theme: Default" type="syntaxhighlighter"><![CDATA[from("direct:start").process(new Processor() {
+ @Override
+ public void process(Exchange exchange) throws Exception {
+ exchange.getIn().setBody("Test Message from Camel Kafka Component Final",String.class);
+ exchange.getIn().setHeader(KafkaConstants.PARTITION_KEY, 0);
+ exchange.getIn().setHeader(KafkaConstants.KEY, "1");
+ }
+ }).to("kafka:localhost:9092?topic=test");
+]]></script>
+</div></div><p> </p><p></p><h2 id="Kafka-Endpoints">Endpoints</h2>
<p></p><p>Camel supports the <a shape="rect" href="message-endpoint.html">Message Endpoint</a> pattern using the <a shape="rect" class="external-link" href="http://camel.apache.org/maven/current/camel-core/apidocs/org/apache/camel/Endpoint.html">Endpoint</a> interface. Endpoints are usually created by a <a shape="rect" href="component.html">Component</a> and Endpoints are usually referred to in the <a shape="rect" href="dsl.html">DSL</a> via their <a shape="rect" href="uris.html">URIs</a>. </p>