You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@flink.apache.org by "Arpith Prakash (Jira)" <ji...@apache.org> on 2020/09/22 16:03:00 UTC

[jira] [Updated] (FLINK-19359) Restore from Checkpoint fails if checkpoint folders is corrupt/partial

     [ https://issues.apache.org/jira/browse/FLINK-19359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Arpith Prakash updated FLINK-19359:
-----------------------------------
    Issue Type: Improvement  (was: Bug)

> Restore from Checkpoint fails if checkpoint folders is corrupt/partial
> ----------------------------------------------------------------------
>
>                 Key: FLINK-19359
>                 URL: https://issues.apache.org/jira/browse/FLINK-19359
>             Project: Flink
>          Issue Type: Improvement
>          Components: Runtime / Checkpointing
>    Affects Versions: 1.8.0
>            Reporter: Arpith Prakash
>            Priority: Major
>         Attachments: Checkpoints.png
>
>
> I'm using Flink 1.8.0 version and have enabled externalized checkpoint to hdfs location, we have seen few scenarios where checkpoint folders will have checkpoint files but only missing "*_metadata*" file. If we attempt to restore application from this path, application fails with exception "Could not find *_metadata* file. There is similar discussion in Flink user mailing list with subject  "Zookeeper connection loss causing checkpoint corruption" around it. I've attached sample snapshot on how folder structure looks as well.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)