You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@flink.apache.org by Steve Jerman <st...@kloudspot.com> on 2017/06/02 15:57:32 UTC
Checkpoints?
Hi,
Configuration:
Flink 1.2.0
I'm using the Rocks DB backend for checkpointing.
The problem I have is that no checkpoints are being deleted, and my disk is filling up.
Is there configuration for this?
Thanks
Steve
Re: Checkpoints?
Posted by Steve Jerman <st...@kloudspot.com>.
Thanks. Upgraded to 1.2.1 - problem goes away
Steve
On Jun 2, 2017, at 10:08 AM, Till Rohrmann <tr...@apache.org>> wrote:
Hi Steve,
in the past we had some problems with cleaning up old checkpoints. But this was in 1.1.x. These problems should be fixed by now.
Could you try upgrading to Flink 1.2.1 in order to see whether the problem persists? If this is the case, then it would be great if you could share the JobManager logs on debug log level with us.
How long is your checkpoint interval? Deleting files from HDFS/S3 can take some time and if the checkpoint interval is shorter than this time, then the system won't be able to delete old checkpoints quick enough.
Cheers,
Till
On Fri, Jun 2, 2017 at 5:57 PM, Steve Jerman <st...@kloudspot.com>> wrote:
Hi,
Configuration:
Flink 1.2.0
I'm using the Rocks DB backend for checkpointing.
The problem I have is that no checkpoints are being deleted, and my disk is filling up.
Is there configuration for this?
Thanks
Steve
Re: Checkpoints?
Posted by Till Rohrmann <tr...@apache.org>.
Hi Steve,
in the past we had some problems with cleaning up old checkpoints. But this
was in 1.1.x. These problems should be fixed by now.
Could you try upgrading to Flink 1.2.1 in order to see whether the problem
persists? If this is the case, then it would be great if you could share
the JobManager logs on debug log level with us.
How long is your checkpoint interval? Deleting files from HDFS/S3 can take
some time and if the checkpoint interval is shorter than this time, then
the system won't be able to delete old checkpoints quick enough.
Cheers,
Till
On Fri, Jun 2, 2017 at 5:57 PM, Steve Jerman <st...@kloudspot.com> wrote:
> Hi,
>
> Configuration:
> Flink 1.2.0
> I'm using the Rocks DB backend for checkpointing.
>
> The problem I have is that no checkpoints are being deleted, and my disk
> is filling up.
>
> Is there configuration for this?
>
> Thanks
> Steve