You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@flink.apache.org by "Nico Kruber (Jira)" <ji...@apache.org> on 2019/12/02 13:09:00 UTC

[jira] [Created] (FLINK-15012) Checkpoint directory not cleaned up

Nico Kruber created FLINK-15012:
-----------------------------------

             Summary: Checkpoint directory not cleaned up
                 Key: FLINK-15012
                 URL: https://issues.apache.org/jira/browse/FLINK-15012
             Project: Flink
          Issue Type: Improvement
          Components: Runtime / Checkpointing
    Affects Versions: 1.9.1
            Reporter: Nico Kruber


I started a Flink cluster with 2 TMs using {{start-cluster.sh}} and the following config (in addition to the default {{flink-conf.yaml}})
{code:java}
state.checkpoints.dir: file:///path/to/checkpoints/
state.backend: rocksdb {code}
After submitting a jobwith checkpoints enabled (every 5s), checkpoints show up, e.g.
{code:java}
bb969f842bbc0ecc3b41b7fbe23b047b/
├── chk-2
│   ├── 238969e1-6949-4b12-98e7-1411c186527c
│   ├── 2702b226-9cfc-4327-979d-e5508ab2e3d5
│   ├── 4c51cb24-6f71-4d20-9d4c-65ed6e826949
│   ├── e706d574-c5b2-467a-8640-1885ca252e80
│   └── _metadata
├── shared
└── taskowned {code}
If I shut down the cluster via {{stop-cluster.sh}}, these files will remain on disk and not be cleaned up.

In contrast, if I cancel the job, at least {{chk-2}} will be deleted, but still leaving the (empty) directories.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)