[jira] [Created] (FLINK-21233) Race condition in CheckpointCoordinator in finishing sync savepoint

["Roman Khachatryan (Jira)" <ji...@apache.org>]

Roman Khachatryan created FLINK-21233:
-----------------------------------------

             Summary: Race condition in CheckpointCoordinator in finishing sync savepoint
                 Key: FLINK-21233
                 URL: https://issues.apache.org/jira/browse/FLINK-21233
             Project: Flink
          Issue Type: Bug
          Components: Runtime / Checkpointing
    Affects Versions: 1.12.1, 1.11.3, 1.13.0
            Reporter: Roman Khachatryan


I'm writing an integration test and see a failure from time to time (1 per 100 on my machine):
{code:java}
Caused by: java.util.concurrent.CompletionException: org.apache.flink.runtime.checkpoint.CheckpointException: CheckpointCoordinator shutdown.
{code}
 

Consider the final stage of the synchronous savepoint (started by stop with savepoint command):
 # The last subtask ACKs the checkpoint
 # CheckpointCoordinator finalizes the checkpoint and sends out confirmations
 # EndOfPartition is generated on sources and flows through the graph
 # Each Subtask notifies the Scheduler about its completion
 # Upon receiving the last notification Scheduler shuts down CheckpointCoordinator
 # CheckpointCoordinator aborts all pending checkpoing

Not that Scheduler and CheckpointCoordinator run in different threads.

So if savepoint finalization takes longer then it can be aborted before completion.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)