You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@pulsar.apache.org by GitBox <gi...@apache.org> on 2020/12/14 09:05:31 UTC

[GitHub] [pulsar] lhotari commented on issue #8343: Kafka source connector doesn't reconnect after kafka restart

lhotari commented on issue #8343:
URL: https://github.com/apache/pulsar/issues/8343#issuecomment-744292914


   One thing to try is to [enable "autoCommitEnabled" configuration](https://pulsar.apache.org/docs/en/io-kafka-source/#configuration) for the Kafka source connector. It should be enabled by default unless it's explicitly disabled.
   
   The reason why this might help is that Kafka Consumer API's commitSync method throws an unchecked exception according to this SO answer: https://stackoverflow.com/a/65193460 .
   That case might not be handled in the Pulsar IO Kafka source connector around https://github.com/apache/pulsar-connectors/blob/master/pulsar-io/kafka/src/main/java/org/apache/pulsar/io/kafka/KafkaAbstractSource.java#L139 .
   `commitSync` won't be called when auto commit is enabled in the Pulsar IO Kafka source connector.
   
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org