You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@flink.apache.org by "Qingsheng Ren (Jira)" <ji...@apache.org> on 2022/08/31 07:02:00 UTC

[jira] [Created] (FLINK-29153) KafkaConsumerThread should catch WakeupException when committing offsets

Qingsheng Ren created FLINK-29153:
-------------------------------------

             Summary: KafkaConsumerThread should catch WakeupException when committing offsets
                 Key: FLINK-29153
                 URL: https://issues.apache.org/jira/browse/FLINK-29153
             Project: Flink
          Issue Type: Bug
          Components: Connectors / Kafka
    Affects Versions: 1.16.0
            Reporter: Qingsheng Ren
            Assignee: Qingsheng Ren
             Fix For: 1.16.0


{{KafkaConsumerThread}} in the legacy {{FlinkKafkaConsumer}} makes a wakeup on the {{KafkaConsumer}} on offset commit to wakeup the potential blocking {{KafkaConsumer.poll()}}. However the wakeup might happen when the consumer is not polling. The wakeup will be remembered by the consumer and re-examined while committing the offset asynchronously, which leads to an unnecessary {{WakeupException}}. 

As the JavaDoc and method signature of KafkaConsumer does not show that the WakeupException could be thrown in KafkaConsumer#commitAsync, this could be considered as a bug on Kafka side (breaking the contract of public API), but we can still fix it by catching the WakeupException and retrying. 



--
This message was sent by Atlassian Jira
(v8.20.10#820010)