You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@camel.apache.org by "Von Landon (JIRA)" <ji...@apache.org> on 2016/11/18 13:46:58 UTC
[jira] [Commented] (CAMEL-10213) Camel Kafka doesn't support
setting "max.poll.records" and "session.timeout.ms"
[ https://issues.apache.org/jira/browse/CAMEL-10213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15676748#comment-15676748 ]
Von Landon commented on CAMEL-10213:
------------------------------------
What is the new consumer option -- "maxPollRecords"? Please update the documentation for the new consumer option at http://camel.apache.org/kafka.html.
> Camel Kafka doesn't support setting "max.poll.records" and "session.timeout.ms"
> --------------------------------------------------------------------------------
>
> Key: CAMEL-10213
> URL: https://issues.apache.org/jira/browse/CAMEL-10213
> Project: Camel
> Issue Type: Improvement
> Components: camel-kafka
> Affects Versions: 2.18.0
> Reporter: Oliver Holzmann
> Assignee: Claus Ibsen
> Priority: Minor
> Fix For: 2.18.0
>
>
> Currently it is not possible to control the processing time in the poll loop in Camel Kafka consumers.
> It is important to have the possibility to control the poll loop by adjusting {{max.poll.records}} and {{session.timeout.ms}} . Otherwise this warning is produced when consuming a large backlog from kafka topic:
> {code}
> Auto offset commit failed for group consumerGroup: Commit cannot be
> completed since the group has already rebalanced and assigned the
> partitions to another member. This means that the time between
> subsequent calls to poll() was longer than the configured
> session.timeout.ms, which typically implies that the poll loop is spending
> too much time message processing. You can address this either by
> increasing the session timeout or by reducing the maximum size of batches
> returned in poll() with max.poll.records.
> {code}
> Please add {{max.poll.records}} and {{session.timeout.ms}} to Kafka endpoint configuration.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)