You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@flink.apache.org by aryan m <ma...@gmail.com> on 2023/02/13 22:15:23 UTC

Non uniform checkpointing intervals

Hi Users!
    On a specific pipeline, we often observe the configs of 2m
checkpointing interval and 1 min pause in-between aren't honored.  At
times, we see gaps upto 50 mins [2] . From logs [1] and UI, the
checkpoints complete under 10s.

While the pipeline is healthy, non uniform checkpointing intervals are a
concern. Curious to hear any root cause/ideas on how to address this.

*Infra*
1. Flink : 1.13
2. Checkpoint storage: FileSystemCheckpointStorage
3. State backend : HashmapStateBackend.


[1]
https://github.com/apache/flink/blob/release-1.13/flink-runtime/src/main/java/org/apache/flink/runtime/checkpoint/CheckpointCoordinator.java#L1246


[2]
[image: image.png]


Thanks
Arya.