You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@flink.apache.org by "Martijn Visser (Jira)" <ji...@apache.org> on 2022/04/13 07:39:00 UTC

[jira] [Commented] (FLINK-27195) KafkaSourceReader offsetsToCommit should be mutable

    [ https://issues.apache.org/jira/browse/FLINK-27195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17521515#comment-17521515 ] 

Martijn Visser commented on FLINK-27195:
----------------------------------------

[~renqs] Could you confirm that this is indeed desired? I have some doubts (because I believe that [~arvid] mentioned that topic partition discovery is always tricky) so rather be safe then sorry :)

> KafkaSourceReader offsetsToCommit should be mutable
> ---------------------------------------------------
>
>                 Key: FLINK-27195
>                 URL: https://issues.apache.org/jira/browse/FLINK-27195
>             Project: Flink
>          Issue Type: Bug
>          Components: Connectors / Kafka
>    Affects Versions: 1.13.6, 1.14.4
>            Reporter: Mason Chen
>            Assignee: Mason Chen
>            Priority: Major
>
> In the KafkaSourceReader, offsetsToCommit should be mutable. Currently, the condition that splits is empty initializes the offsets to commit as an immutable empty map. However, it is possible to have splits assigned after a checkpoint is taken (e.g. discovered topic partitions). Therefore, offsets to commit should be mutable.



--
This message was sent by Atlassian Jira
(v8.20.1#820001)