You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@flink.apache.org by "Mason Chen (Jira)" <ji...@apache.org> on 2022/11/03 02:50:00 UTC

[jira] [Created] (FLINK-29856) Triggering savepoint does not trigger source operator checkpoint

Mason Chen created FLINK-29856:
----------------------------------

             Summary: Triggering savepoint does not trigger source operator checkpoint 
                 Key: FLINK-29856
                 URL: https://issues.apache.org/jira/browse/FLINK-29856
             Project: Flink
          Issue Type: Improvement
          Components: Runtime / Checkpointing
    Affects Versions: 1.16.0
            Reporter: Mason Chen


When I trigger a savepoint with the Flink K8s operator, I verified for two sources (KafkaSource and MultiClusterKafkaSource) do not invoke snapshotState or notifyCheckpointComplete. This is easily reproducible in a simple pipeline (e.g. KafkaSource -> print).

 

However, when the checkpoint occurs via the interval, I do see the sources checkpointing properly and expected logs in the output.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

Re: [jira] [Created] (FLINK-29856) Triggering savepoint does not trigger source operator checkpoint

Posted by Maximilian Michels <mx...@apache.org>.
This sounds like a pretty serious issue. Has anybody looked into this
already?

-Max

On Thu, Nov 3, 2022 at 3:51 AM Mason Chen (Jira) <ji...@apache.org> wrote:

> Mason Chen created FLINK-29856:
> ----------------------------------
>
>              Summary: Triggering savepoint does not trigger source
> operator checkpoint
>                  Key: FLINK-29856
>                  URL: https://issues.apache.org/jira/browse/FLINK-29856
>              Project: Flink
>           Issue Type: Improvement
>           Components: Runtime / Checkpointing
>     Affects Versions: 1.16.0
>             Reporter: Mason Chen
>
>
> When I trigger a savepoint with the Flink K8s operator, I verified for two
> sources (KafkaSource and MultiClusterKafkaSource) do not invoke
> snapshotState or notifyCheckpointComplete. This is easily reproducible in a
> simple pipeline (e.g. KafkaSource -> print).
>
>
>
> However, when the checkpoint occurs via the interval, I do see the sources
> checkpointing properly and expected logs in the output.
>
>
>
> --
> This message was sent by Atlassian Jira
> (v8.20.10#820010)
>