[GitHub] [camel-kafka-connector] arjun180 commented on issue #1236: idempotency support in Kafka AWS s3 source connector

[GitBox <gi...@apache.org>]

arjun180 commented on issue #1236:
URL: https://github.com/apache/camel-kafka-connector/issues/1236#issuecomment-884382350


   Thanks @oscerd. I tried increasing the cache size, and I'm getting a strange error on the broker side of things. I'm wondering if it's got something to do with the Kafka Connect plugin or something.
   
   ```
   2021-07-21 05:14:45,886 INFO Kafka version: 2.8.0 (org.apache.kafka.common.utils.AppInfoParser) [task-thread-s3-source-connector-0]
   2021-07-21 05:14:45,886 INFO Kafka commitId: ebb1d6e21cc92130 (org.apache.kafka.common.utils.AppInfoParser) [task-thread-s3-source-connector-0]
   2021-07-21 05:14:45,886 INFO Kafka startTimeMs: 1626844485886 (org.apache.kafka.common.utils.AppInfoParser) [task-thread-s3-source-connector-0]
   2021-07-21 05:14:45,887 INFO Warming up cache from topic my.idempotency.topic (org.apache.camel.processor.idempotent.kafka.KafkaIdempotentRepository) [task-thread-s3-source-connector-0]
   2021-07-21 05:14:45,888 INFO [Consumer clientId=consumer-7948c941-10d7-4120-82f2-e550ba0d477b-6, groupId=7948c941-10d7-4120-82f2-e550ba0d477b] Subscribed to topic(s): my.idempotency.topic (org.apache.kafka.clients.consumer.KafkaConsumer) [Camel (camel-38) thread #74 - KafkaIdempotentRepository]
   2021-07-21 05:14:45,889 WARN [Producer clientId=producer-6] Connection to node -1 (localhost/127.0.0.1:9092) could not be established. Broker may not be available. (org.apache.kafka.clients.NetworkClient) [kafka-producer-network-thread | producer-6]
   2021-07-21 05:14:45,889 WARN [Producer clientId=producer-6] Bootstrap broker localhost:9092 (id: -1 rack: null) disconnected (org.apache.kafka.clients.NetworkClient) [kafka-producer-network-thread | producer-6]
   2021-07-21 05:14:45,889 WARN [Consumer clientId=consumer-7948c941-10d7-4120-82f2-e550ba0d477b-6, groupId=7948c941-10d7-4120-82f2-e550ba0d477b] Connection to node -1 (localhost/127.0.0.1:9092) could not be established. Broker may not be available. (org.apache.kafka.clients.NetworkClient) [Camel (camel-38) thread #74 - KafkaIdempotentRepository]
   
   ```
   The broker connection is not a problem without the idempotency configurations. 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@camel.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org