You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "xiaodao (Jira)" <ji...@apache.org> on 2022/12/14 09:29:00 UTC
[jira] [Updated] (FLINK-30412) create many checkpoint empty dir when job not enable checkpoint
[ https://issues.apache.org/jira/browse/FLINK-30412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
xiaodao updated FLINK-30412:
----------------------------
Affects Version/s: 1.13.6
1.12.7
> create many checkpoint empty dir when job not enable checkpoint
> ---------------------------------------------------------------
>
> Key: FLINK-30412
> URL: https://issues.apache.org/jira/browse/FLINK-30412
> Project: Flink
> Issue Type: Improvement
> Components: API / DataStream
> Affects Versions: 1.12.7, 1.13.6, 1.15.2
> Reporter: xiaodao
> Priority: Major
>
> when we submit job to flink session cluster , after a long time, we find it create too much
> empty checkpoint dir,and it over hdfs max node limit ;
> i found StreamingJobGraphGenerator set snapshot whennever the job is open checkpoint;
> jobGraph.setSnapshotSettings(settings)
> {code:java}
> private void configureCheckpointing()
> CheckpointConfig cfg = streamGraph.getCheckpointConfig(); long interval = cfg.getCheckpointInterval(); if (interval < MINIMAL_CHECKPOINT_TIME) { // interval of max value means disable periodic checkpoint interval = Long.MAX_VALUE; }
> {code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)