You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@flink.apache.org by "Jiangjie Qin (Jira)" <ji...@apache.org> on 2020/11/17 15:26:00 UTC

[jira] [Created] (FLINK-20194) KafkaSourceFetcherManager.commitOffsets() should handle the case when there is no split fetcher.

Jiangjie Qin created FLINK-20194:
------------------------------------

             Summary: KafkaSourceFetcherManager.commitOffsets() should handle the case when there is no split fetcher.
                 Key: FLINK-20194
                 URL: https://issues.apache.org/jira/browse/FLINK-20194
             Project: Flink
          Issue Type: Bug
          Components: Connectors / Kafka
            Reporter: Jiangjie Qin


The {{KafkaSourceFetcherManager.commitOffsets()}} may throw NPE when there is no split fetcher. Given that such cases should usually be rare and only happens when the source is shutting down or just started. We can create a new {{KafkaPartitionSplitReader}} to commit offset and close it immediately. The main thread maybe blocked for some time, but given that there is no event to process at that point, there should be no performance concerns.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)