You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@camel.apache.org by "Otavio Rodolfo Piske (Jira)" <ji...@apache.org> on 2021/12/06 18:28:00 UTC
[jira] [Commented] (CAMEL-17285) camel-kafka: async manual commit is not working
[ https://issues.apache.org/jira/browse/CAMEL-17285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17454169#comment-17454169 ]
Otavio Rodolfo Piske commented on CAMEL-17285:
----------------------------------------------
Updating to test. We changed the way we handle manual commit factories and the older one stopped working.
> camel-kafka: async manual commit is not working
> -----------------------------------------------
>
> Key: CAMEL-17285
> URL: https://issues.apache.org/jira/browse/CAMEL-17285
> Project: Camel
> Issue Type: Test
> Components: camel-kafka
> Affects Versions: 3.14.0
> Reporter: Otavio Rodolfo Piske
> Assignee: Otavio Rodolfo Piske
> Priority: Major
> Fix For: 3.14.0
>
>
> Recently the async manual commit support for Kafka has stopped working. It needs to be investigated.
>
> Kafka's client is not thread safe and a recent change may have moved the thread responsible for creating it and/or performing the commit:
>
> {noformat}
>
> java.util.ConcurrentModificationException: KafkaConsumer is not safe for multi-threaded access
> at org.apache.kafka.clients.consumer.KafkaConsumer.acquire(KafkaConsumer.java:2445) ~[kafka-clients-2.8.1.jar:?]
> at org.apache.kafka.clients.consumer.KafkaConsumer.acquireAndEnsureOpen(KafkaConsumer.java:2429) ~[kafka-clients-2.8.1.jar:?]
> at org.apache.kafka.clients.consumer.KafkaConsumer.commitSync(KafkaConsumer.java:1486) ~[kafka-clients-2.8.1.jar:?]
> at org.apache.camel.component.kafka.DefaultKafkaManualSyncCommit.commitOffset(DefaultKafkaManualSyncCommit.java:58) ~[classes/:?]
> at org.apache.camel.component.kafka.DefaultKafkaManualSyncCommit.commit(DefaultKafkaManualSyncCommit.java:49) ~[classes/:?]
> at org.apache.camel.component.kafka.integration.KafkaConsumerAsyncManualCommitIT$1.lambda$configure$0(KafkaConsumerAsyncManualCommitIT.java:92) ~[test-classes/:?]
> at org.apache.camel.support.processor.DelegateSyncProcessor.process(DelegateSyncProcessor.java:65) ~[classes/:?]
> at org.apache.camel.processor.errorhandler.RedeliveryErrorHandler$SimpleTask.run(RedeliveryErrorHandler.java:469) ~[classes/:?]
> at org.apache.camel.impl.engine.DefaultReactiveExecutor$Worker.schedule(DefaultReactiveExecutor.java:187) ~[classes/:?]
> at org.apache.camel.impl.engine.DefaultReactiveExecutor.schedule(DefaultReactiveExecutor.java:59) ~[classes/:?]
> at org.apache.camel.processor.aggregate.AggregateProcessor.lambda$onSubmitCompletion$4(AggregateProcessor.java:891) ~[classes/:?]
> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) [?:?]
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) [?:?]
> at java.lang.Thread.run(Thread.java:829) [?:?]
> {noformat}
>
--
This message was sent by Atlassian Jira
(v8.20.1#820001)