Enabling Flink’s checkpointing

[Olga Luganska <tr...@hotmail.com>]

Hello,

By reading Flink documentation I see that to enable checkpointing we need to:

1. Enable checkpointing at the execution environment.

2. Make sure that your source/sink implements either CheckpointedFunction or ListCheckpointed interfaces?

Is #2 a must, and how checkpointing mechanism is affected if your source does not implement mentioned above interfaces?

(I see example of using RuntimeContext accessing keyed state)

Please explain.
Thank you very much,
Olga


Sent from my iPhone

Re: Enabling Flink’s checkpointing

[Andrey Zagrebin <an...@data-artisans.com>]

Hi Olga,

Not sure where it is stated in the docs to make sure that source/sink implements the interface.

From what I see in the source code, if a user function does not implement CheckpointedFunction or ListCheckpointed, its operator state will just not be snapshotted, but I do not see any problem for enabled checkpoint to snapshot what supports it and success for the job.

Best,
Andrey

> On 15 Nov 2018, at 18:20, Olga Luganska <tr...@hotmail.com> wrote:
> 
> Hello,
> 
> By reading Flink documentation I see that to enable checkpointing we need to:
> 
> 1. Enable checkpointing at the execution environment.
> 
> 2. Make sure that your source/sink implements either CheckpointedFunction or ListCheckpointed interfaces?
> 
> Is #2 a must, and how checkpointing mechanism is affected if your source does not implement mentioned above interfaces?
> 
> (I see example of using RuntimeContext accessing keyed state)
> 
> Please explain.
> Thank you very much,
> Olga
> 
> 
> Sent from my iPhone