You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@flink.apache.org by Ori Popowski <or...@gmail.com> on 2022/11/20 14:00:29 UTC

Unaligned Checkpoints disabled even though I enabled them

Hi,

I am running Flink 1.15

I ran the job with execution.checkpointing.unaligned=true and it shows up
also in the Flink UI in the Job Manager Configuration. However, in the
"Configuration" tab under "Checkpoints" I see "Unaligned Checkpoints" as
"Disabled". See screenshots below.

Why does it happen?

Thanks
[image: Capture d’écran 2022-11-20 à 15.58.15.png]
[image: Capture d’écran 2022-11-20 à 15.59.04.png]

Re: Unaligned Checkpoints disabled even though I enabled them

Posted by Ori Popowski <or...@gmail.com>.

Hi,

Thanks for answering. No, aligned-checkpoint-timeout property isn't set
neither in the job code nor the configuration.

I understood that unaligned checkpoints are meaningless in at
least-once-semantics, isn't that the case?

Thanks

On Mon, Nov 21, 2022 at 7:35 AM yidan zhao <hi...@gmail.com> wrote:

> Maybe your job code set it to disabled? The picture only shows the
> cluster's default setting.
>
> Yanfei Lei <fr...@gmail.com> 于2022年11月21日周一 10:34写道：
>
>> Hi Ori Popowski,
>> One possibility is that "aligned-checkpoint-timeout" is set at the same
>> time.  ” If the "aligned-checkpoint-timeout"[1] is set, each checkpoint
>> will still begin as an aligned checkpoint, but when the global checkpoint
>> duration exceeds the aligned-checkpoint-timeout, if the aligned checkpoint
>> has not completed, then the checkpoint will proceed as an unaligned
>> checkpoint.
>> Maybe you can check your code or flink-conf.yaml to see whether "aligned-checkpoint-timeout"
>> is set.
>>
>> [1]
>> https://nightlies.apache.org/flink/flink-docs-release-1.16/docs/ops/state/checkpointing_under_backpressure/#aligned-checkpoint-timeout
>>
>> Ori Popowski <or...@gmail.com> 于2022年11月20日周日 23:26写道：
>>
>>> I didn't see it in the documentation but it makes sense.
>>>
>>> In this case there should be an indication in the logs that it's not
>>> supported, in any case.
>>>
>>> Thanks
>>>
>>> On Sun, Nov 20, 2022 at 5:21 PM Alexis Sarda-Espinosa <
>>> sarda.espinosa@gmail.com> wrote:
>>>
>>>> The documentation states that they can only be enabled if
>>>> execution.checkpointing.mode is EXACTLY_ONCE (and max concurrency for
>>>> checkpoints is 1, which you already have).
>>>>
>>>> Regards,
>>>> Alexis.
>>>>
>>>> On Sun, 20 Nov 2022, 15:00 Ori Popowski, <or...@gmail.com> wrote:
>>>>
>>>>> Hi,
>>>>>
>>>>> I am running Flink 1.15
>>>>>
>>>>> I ran the job with execution.checkpointing.unaligned=true and it
>>>>> shows up also in the Flink UI in the Job Manager Configuration. However, in
>>>>> the "Configuration" tab under "Checkpoints" I see "Unaligned Checkpoints"
>>>>> as "Disabled". See screenshots below.
>>>>>
>>>>> Why does it happen?
>>>>>
>>>>> Thanks
>>>>> [image: Capture d’écran 2022-11-20 à 15.58.15.png]
>>>>> [image: Capture d’écran 2022-11-20 à 15.59.04.png]
>>>>>
>>>>>
>>
>> --
>> Best,
>> Yanfei
>>
>

Re: Unaligned Checkpoints disabled even though I enabled them

Posted by yidan zhao <hi...@gmail.com>.

Maybe your job code set it to disabled? The picture only shows the
cluster's default setting.

Yanfei Lei <fr...@gmail.com> 于2022年11月21日周一 10:34写道：

> Hi Ori Popowski,
> One possibility is that "aligned-checkpoint-timeout" is set at the same
> time.  ” If the "aligned-checkpoint-timeout"[1] is set, each checkpoint
> will still begin as an aligned checkpoint, but when the global checkpoint
> duration exceeds the aligned-checkpoint-timeout, if the aligned checkpoint
> has not completed, then the checkpoint will proceed as an unaligned
> checkpoint.
> Maybe you can check your code or flink-conf.yaml to see whether "aligned-checkpoint-timeout"
> is set.
>
> [1]
> https://nightlies.apache.org/flink/flink-docs-release-1.16/docs/ops/state/checkpointing_under_backpressure/#aligned-checkpoint-timeout
>
> Ori Popowski <or...@gmail.com> 于2022年11月20日周日 23:26写道：
>
>> I didn't see it in the documentation but it makes sense.
>>
>> In this case there should be an indication in the logs that it's not
>> supported, in any case.
>>
>> Thanks
>>
>> On Sun, Nov 20, 2022 at 5:21 PM Alexis Sarda-Espinosa <
>> sarda.espinosa@gmail.com> wrote:
>>
>>> The documentation states that they can only be enabled if
>>> execution.checkpointing.mode is EXACTLY_ONCE (and max concurrency for
>>> checkpoints is 1, which you already have).
>>>
>>> Regards,
>>> Alexis.
>>>
>>> On Sun, 20 Nov 2022, 15:00 Ori Popowski, <or...@gmail.com> wrote:
>>>
>>>> Hi,
>>>>
>>>> I am running Flink 1.15
>>>>
>>>> I ran the job with execution.checkpointing.unaligned=true and it shows
>>>> up also in the Flink UI in the Job Manager Configuration. However, in the
>>>> "Configuration" tab under "Checkpoints" I see "Unaligned Checkpoints" as
>>>> "Disabled". See screenshots below.
>>>>
>>>> Why does it happen?
>>>>
>>>> Thanks
>>>> [image: Capture d’écran 2022-11-20 à 15.58.15.png]
>>>> [image: Capture d’écran 2022-11-20 à 15.59.04.png]
>>>>
>>>>
>
> --
> Best,
> Yanfei
>

Re: Unaligned Checkpoints disabled even though I enabled them

Posted by Yanfei Lei <fr...@gmail.com>.

Hi Ori Popowski,
One possibility is that "aligned-checkpoint-timeout" is set at the same
time.  ” If the "aligned-checkpoint-timeout"[1] is set, each checkpoint
will still begin as an aligned checkpoint, but when the global checkpoint
duration exceeds the aligned-checkpoint-timeout, if the aligned checkpoint
has not completed, then the checkpoint will proceed as an unaligned
checkpoint.
Maybe you can check your code or flink-conf.yaml to see whether
"aligned-checkpoint-timeout"
is set.

[1]
https://nightlies.apache.org/flink/flink-docs-release-1.16/docs/ops/state/checkpointing_under_backpressure/#aligned-checkpoint-timeout

Ori Popowski <or...@gmail.com> 于2022年11月20日周日 23:26写道：

> I didn't see it in the documentation but it makes sense.
>
> In this case there should be an indication in the logs that it's not
> supported, in any case.
>
> Thanks
>
> On Sun, Nov 20, 2022 at 5:21 PM Alexis Sarda-Espinosa <
> sarda.espinosa@gmail.com> wrote:
>
>> The documentation states that they can only be enabled if
>> execution.checkpointing.mode is EXACTLY_ONCE (and max concurrency for
>> checkpoints is 1, which you already have).
>>
>> Regards,
>> Alexis.
>>
>> On Sun, 20 Nov 2022, 15:00 Ori Popowski, <or...@gmail.com> wrote:
>>
>>> Hi,
>>>
>>> I am running Flink 1.15
>>>
>>> I ran the job with execution.checkpointing.unaligned=true and it shows
>>> up also in the Flink UI in the Job Manager Configuration. However, in the
>>> "Configuration" tab under "Checkpoints" I see "Unaligned Checkpoints" as
>>> "Disabled". See screenshots below.
>>>
>>> Why does it happen?
>>>
>>> Thanks
>>> [image: Capture d’écran 2022-11-20 à 15.58.15.png]
>>> [image: Capture d’écran 2022-11-20 à 15.59.04.png]
>>>
>>>

-- 
Best,
Yanfei

Re: Unaligned Checkpoints disabled even though I enabled them

Posted by Ori Popowski <or...@gmail.com>.

I didn't see it in the documentation but it makes sense.

In this case there should be an indication in the logs that it's not
supported, in any case.

Thanks

On Sun, Nov 20, 2022 at 5:21 PM Alexis Sarda-Espinosa <
sarda.espinosa@gmail.com> wrote:

> The documentation states that they can only be enabled if
> execution.checkpointing.mode is EXACTLY_ONCE (and max concurrency for
> checkpoints is 1, which you already have).
>
> Regards,
> Alexis.
>
> On Sun, 20 Nov 2022, 15:00 Ori Popowski, <or...@gmail.com> wrote:
>
>> Hi,
>>
>> I am running Flink 1.15
>>
>> I ran the job with execution.checkpointing.unaligned=true and it shows
>> up also in the Flink UI in the Job Manager Configuration. However, in the
>> "Configuration" tab under "Checkpoints" I see "Unaligned Checkpoints" as
>> "Disabled". See screenshots below.
>>
>> Why does it happen?
>>
>> Thanks
>> [image: Capture d’écran 2022-11-20 à 15.58.15.png]
>> [image: Capture d’écran 2022-11-20 à 15.59.04.png]
>>
>>

Re: Unaligned Checkpoints disabled even though I enabled them

Posted by Alexis Sarda-Espinosa <sa...@gmail.com>.

The documentation states that they can only be enabled if
execution.checkpointing.mode is EXACTLY_ONCE (and max concurrency for
checkpoints is 1, which you already have).

Regards,
Alexis.

On Sun, 20 Nov 2022, 15:00 Ori Popowski, <or...@gmail.com> wrote:

> Hi,
>
> I am running Flink 1.15
>
> I ran the job with execution.checkpointing.unaligned=true and it shows up
> also in the Flink UI in the Job Manager Configuration. However, in the
> "Configuration" tab under "Checkpoints" I see "Unaligned Checkpoints" as
> "Disabled". See screenshots below.
>
> Why does it happen?
>
> Thanks
> [image: Capture d’écran 2022-11-20 à 15.58.15.png]
> [image: Capture d’écran 2022-11-20 à 15.59.04.png]
>
>