You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@flink.apache.org by "elon_X (Jira)" <ji...@apache.org> on 2024/06/03 15:40:00 UTC

[jira] [Updated] (FLINK-35506) disable kafka auto-commit and rely on flink’s checkpointing if both are enabled

     [ https://issues.apache.org/jira/browse/FLINK-35506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

elon_X updated FLINK-35506:
---------------------------
    Attachment: image-2024-06-03-23-39-28-270.png

> disable kafka auto-commit and rely on flink’s checkpointing if both are enabled
> -------------------------------------------------------------------------------
>
>                 Key: FLINK-35506
>                 URL: https://issues.apache.org/jira/browse/FLINK-35506
>             Project: Flink
>          Issue Type: Improvement
>          Components: Connectors / Kafka
>    Affects Versions: 1.16.1
>            Reporter: elon_X
>            Priority: Major
>         Attachments: image-2024-06-03-23-39-28-270.png
>
>
> When I use KafkaSource for consuming topics and set the Kafka parameter {{{}enable.auto.commit=true{}}}, while also enabling checkpointing for the task, I notice that both will commit offsets. Should Kafka's auto-commit be disabled when enabling Flink checkpointing, similar to how it's done with FlinkKafkaConsumer?



--
This message was sent by Atlassian Jira
(v8.20.10#820010)