[jira] [Resolved] (FLINK-28597) Empty checkpoint folders not deleted on job cancellation if their shared state is still in use

["Roman Khachatryan (Jira)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/FLINK-28597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Roman Khachatryan resolved FLINK-28597.
---------------------------------------
    Resolution: Fixed

Merged as d8a4304b892412eab4c5c19b5deb84166943d3bb.

> Empty checkpoint folders not deleted on job cancellation if their shared state is still in use
> ----------------------------------------------------------------------------------------------
>
>                 Key: FLINK-28597
>                 URL: https://issues.apache.org/jira/browse/FLINK-28597
>             Project: Flink
>          Issue Type: Bug
>          Components: Runtime / Checkpointing
>    Affects Versions: 1.16.0
>            Reporter: Roman Khachatryan
>            Assignee: Roman Khachatryan
>            Priority: Major
>              Labels: pull-request-available
>             Fix For: 1.16.0
>
>
> After FLINK-25872, SharedStateRegistry registers all state handles, including private ones.
> Once the state isn't use AND the checkpoint is subsumed, it will actually be discarded.
> This is done to prevent premature deletion when recovering in CLAIM mode:
> 1. RocksDB native savepoint folder (shared state is stored in chk-xx folder so it might fail the deletion)
> 2. Initial non-changelog checkpoint when switching to changelog-based checkpoints (private state of the initial checkpoint might be included into later checkpoints and its deletion would invalidate them)
> Additionally, checkpoint folders are not deleted for a longer time which might be confusing.
> In case of a crash, more folders will remain.
> cc: [~Yanfei Lei], [~ym]



--
This message was sent by Atlassian Jira
(v8.20.10#820010)