You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@flink.apache.org by "Qingsheng Ren (Jira)" <ji...@apache.org> on 2022/08/31 07:02:00 UTC
[jira] [Created] (FLINK-29153) KafkaConsumerThread should catch WakeupException when committing offsets
Qingsheng Ren created FLINK-29153:
-------------------------------------
Summary: KafkaConsumerThread should catch WakeupException when committing offsets
Key: FLINK-29153
URL: https://issues.apache.org/jira/browse/FLINK-29153
Project: Flink
Issue Type: Bug
Components: Connectors / Kafka
Affects Versions: 1.16.0
Reporter: Qingsheng Ren
Assignee: Qingsheng Ren
Fix For: 1.16.0
{{KafkaConsumerThread}} in the legacy {{FlinkKafkaConsumer}} makes a wakeup on the {{KafkaConsumer}} on offset commit to wakeup the potential blocking {{KafkaConsumer.poll()}}. However the wakeup might happen when the consumer is not polling. The wakeup will be remembered by the consumer and re-examined while committing the offset asynchronously, which leads to an unnecessary {{WakeupException}}.
As the JavaDoc and method signature of KafkaConsumer does not show that the WakeupException could be thrown in KafkaConsumer#commitAsync, this could be considered as a bug on Kafka side (breaking the contract of public API), but we can still fix it by catching the WakeupException and retrying.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)