You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@flink.apache.org by "Piotr Nowojski (Jira)" <ji...@apache.org> on 2021/12/13 14:25:00 UTC

[jira] [Created] (FLINK-25276) Support native and incremental savepoints

Piotr Nowojski created FLINK-25276:
--------------------------------------

             Summary: Support native and incremental savepoints
                 Key: FLINK-25276
                 URL: https://issues.apache.org/jira/browse/FLINK-25276
             Project: Flink
          Issue Type: New Feature
            Reporter: Piotr Nowojski


Motivation. Currently with non incremental canonical format savepoints, with very large state, both taking and recovery from savepoints can take very long time. Providing options to take native format and incremental savepoint would alleviate this problem.

In the past the main challenge lied in the ownership semantic and files clean up of such incremental savepoints. However with FLINK-25154 implemented some of those concerns can be solved. Incremental savepoint could leverage "force full snapshot" mode provided by FLINK-25192, to duplicate/copy all of the savepoint files out of the Flink's ownership scope.



--
This message was sent by Atlassian Jira
(v8.20.1#820001)