You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@flink.apache.org by "Arpith Prakash (Jira)" <ji...@apache.org> on 2020/09/22 11:17:00 UTC

[jira] [Created] (FLINK-19359) Restore from Checkpoint fails if checkpoint folders is corrupt/partial

Arpith Prakash created FLINK-19359:
--------------------------------------

             Summary: Restore from Checkpoint fails if checkpoint folders is corrupt/partial
                 Key: FLINK-19359
                 URL: https://issues.apache.org/jira/browse/FLINK-19359
             Project: Flink
          Issue Type: Bug
          Components: Runtime / Checkpointing
    Affects Versions: 1.8.0
            Reporter: Arpith Prakash
         Attachments: Checkpoints.png

I'm using Flink 1.8.0 version and have enabled externalized checkpoint to hdfs location, we have seen few scenarios where checkpoint folders will have checkpoint files but only missing "*_metadata*" file. If we attempt to restore application from this path, application fails with exception "Could not find *_metadata* file. There is similar discussion in Flink user mailing list with subject  "Zookeeper connection loss causing checkpoint corruption" around it. I've attached sample snapshot on how folder structure looks as well.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)