You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Nico Kruber (Jira)" <ji...@apache.org> on 2020/01/06 13:18:00 UTC
[jira] [Commented] (FLINK-11789) Checkpoint directories are not
cleaned up after job termination
[ https://issues.apache.org/jira/browse/FLINK-11789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17008837#comment-17008837 ]
Nico Kruber commented on FLINK-11789:
-------------------------------------
One more thing to consider: I was using Azure Blob Storage for the checkpoints and savepoints directories and a job with no checkpoints. Now, I took some savepoints and still have the aforementioned directories lying around (while the job is running and afterwards as elaborated above). Since a savepoint essentially/almost does the same thing as a checkpoint, I do get the part of these directories being there, but without active checkpoints, they are strictly not even necessary in the first place.
However, I just wanted to point out that this also affects jobs with savepoints only.
> Checkpoint directories are not cleaned up after job termination
> ---------------------------------------------------------------
>
> Key: FLINK-11789
> URL: https://issues.apache.org/jira/browse/FLINK-11789
> Project: Flink
> Issue Type: Bug
> Components: Runtime / Checkpointing
> Affects Versions: 1.9.0
> Reporter: Till Rohrmann
> Priority: Major
>
> Flink currently does not clean up all checkpoint directories when a job reaches a globally terminal state. Having configured the checkpoint directory {{checkpoints}}, I observe that after cancelling the job {{JOB_ID}} there are still
> {code}
> checkpoints/JOB_ID/shared
> checkpoints/JOB_ID/taskowned
> {code}
> I think it would be good if would delete {{checkpoints/JOB_ID}}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)