You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Yun Tang (Jira)" <ji...@apache.org> on 2020/12/25 02:47:00 UTC
[jira] [Comment Edited] (FLINK-20762) Remove unused
checkpointStorage path after job finished
[ https://issues.apache.org/jira/browse/FLINK-20762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17254710#comment-17254710 ]
Yun Tang edited comment on FLINK-20762 at 12/25/20, 2:46 AM:
-------------------------------------------------------------
[~Jiangang] I think you could read some existing information and progress in FLINK-15012, and then share your comments.
was (Author: yunta):
[~Jiangang] I think you could read some existing information and progress in FLINK-10346, and then share your comments.
> Remove unused checkpointStorage path after job finished
> -------------------------------------------------------
>
> Key: FLINK-20762
> URL: https://issues.apache.org/jira/browse/FLINK-20762
> Project: Flink
> Issue Type: Improvement
> Reporter: Liu
> Priority: Minor
>
> Current checkpoint structure is as following:
> {code:java}
> /user-defined-checkpoint-dir
> |
> + --shared/
> + --taskowned/
> + --chk-00001/
> + --chk-00002/...
> {code}
> After cancelling job, the checkpointStorage will not be removed. For some cases, the dictionary can not be removed. For example, external checkpoint is retained or taskowned is used.
> If all the sub-dictionaries are empty, maybe the checkpointStorage can be removed. Otherwise, there will be lots of unused dictionaries with time going on. I wonder whether this is a problem. If so, I would like to fix it. Thank you.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)