[jira] [Created] (FLINK-20872) Job resume from history savepoint when failover if checkpoint is disabled

["Liu (Jira)" <ji...@apache.org>]

Liu created FLINK-20872:
---------------------------

             Summary: Job resume from history savepoint when failover if checkpoint is disabled
                 Key: FLINK-20872
                 URL: https://issues.apache.org/jira/browse/FLINK-20872
             Project: Flink
          Issue Type: Improvement
    Affects Versions: 1.12.0, 1.11.0
            Reporter: Liu


I have a long running job. Its checkpoint is disabled and restartStrategy is set.  One time I upgrade the job through savepoint. One day later, the job is failed and restart automatically. But it is resumed from the previous savepoint so that the job is heavily lagged.

 

I have checked the code and find that the job will first try to resume from checkpoint and then savepoint.
{code:java}
if (checkpointCoordinator != null) {
    // check whether we find a valid checkpoint
    if (!checkpointCoordinator.restoreInitialCheckpointIfPresent(
            new HashSet<>(newExecutionGraph.getAllVertices().values()))) {

        // check whether we can restore from a savepoint
        tryRestoreExecutionGraphFromSavepoint(
                newExecutionGraph, jobGraph.getSavepointRestoreSettings());
    }
}
{code}
For job which checkpoint is disabled, internal failover should not resume from previous savepoint, especially the savepoint is done long long ago. In this situation, state loss is acceptable but lag is not acceptable.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)