[jira] [Created] (HUDI-4083) Fix the flink application fails to start due to uncompleted archiving deletion

["Ying Lin (Jira)" <ji...@apache.org>]

Ying Lin created HUDI-4083:
------------------------------

             Summary: Fix the flink application fails to start due to uncompleted archiving deletion
                 Key: HUDI-4083
                 URL: https://issues.apache.org/jira/browse/HUDI-4083
             Project: Apache Hudi
          Issue Type: Bug
          Components: archiving
            Reporter: Ying Lin


Suppose a flink application crashes while archiving, it leaves some instant files that should be deleted.

If the commit file is deleted but the in-flight file is left, when the flink application starts, it will scan and get the last pending instant and throw an exception.

So we need to delete non-commit file first, and then delete commit file.



--
This message was sent by Atlassian Jira
(v8.20.7#820007)