You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Jason Zhou (JIRA)" <ji...@apache.org> on 2017/07/19 13:07:00 UTC
[jira] [Updated] (FLINK-7229) Flink doesn't deleted old checkpoint
[ https://issues.apache.org/jira/browse/FLINK-7229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jason Zhou updated FLINK-7229:
------------------------------
Description:
I have a 6-node Flink cluster where one contains jobmanager and the others have only taskmanagers. All taskmanagers have the following config :
`
state.backend: rocksdb
state.backend.rocksdb.checkpointdir: file:///opt/flink/data/local-checkpoints
state.backend.fs.checkpointdir: file:///opt/flink/data/local-checkpoints
state.checkpoints.dir: file:///opt/flink/data/glusterfs/external-checkpoints
state.checkpoints.num-retained: 3
`
And both checkpoints and external-checkpoints are enabled in my code. I can see that for the external-checkpoint, Flink retains 3 checkpoints metadata. However, for the local-checkpoint, only one node(with jobmanager) retains 3 checkpoints and the others don't delete checkpoints.
was:
I have a 6-node Flink cluster where one contains jobmanager and the others have only taskmanagers. All taskmanagers have the following config :
```
state.backend: rocksdb
state.backend.rocksdb.checkpointdir: file:///opt/flink/data/local-checkpoints
state.backend.fs.checkpointdir: file:///opt/flink/data/local-checkpoints
state.checkpoints.dir: file:///opt/flink/data/glusterfs/external-checkpoints
state.checkpoints.num-retained: 3
```
And both checkpoints and external-checkpoints are enabled in my code. I can see that for the external-checkpoint, Flink retains 3 checkpoints metadata. However, for the local-checkpoint, only one node(with jobmanager) retains 3 checkpoints and the others don't delete checkpoints.
> Flink doesn't deleted old checkpoint
> ------------------------------------
>
> Key: FLINK-7229
> URL: https://issues.apache.org/jira/browse/FLINK-7229
> Project: Flink
> Issue Type: Bug
> Components: State Backends, Checkpointing
> Affects Versions: 1.3.1
> Environment: Six Flink nodes running on Ubuntu 14.04.5 LTS (GNU/Linux 3.13.0-121-generic x86_64)
> Reporter: Jason Zhou
>
> I have a 6-node Flink cluster where one contains jobmanager and the others have only taskmanagers. All taskmanagers have the following config :
> `
> state.backend: rocksdb
> state.backend.rocksdb.checkpointdir: file:///opt/flink/data/local-checkpoints
> state.backend.fs.checkpointdir: file:///opt/flink/data/local-checkpoints
> state.checkpoints.dir: file:///opt/flink/data/glusterfs/external-checkpoints
> state.checkpoints.num-retained: 3
> `
> And both checkpoints and external-checkpoints are enabled in my code. I can see that for the external-checkpoint, Flink retains 3 checkpoints metadata. However, for the local-checkpoint, only one node(with jobmanager) retains 3 checkpoints and the others don't delete checkpoints.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)