You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "Timothy Brown (Jira)" <ji...@apache.org> on 2025/07/31 13:54:00 UTC

[jira] [Created] (HUDI-9675) Savepoint safety checks are missing for cleaner policy KEEP_LATEST_FILE_VERSIONS

Timothy Brown created HUDI-9675:
-----------------------------------

             Summary: Savepoint safety checks are missing for cleaner policy KEEP_LATEST_FILE_VERSIONS
                 Key: HUDI-9675
                 URL: https://issues.apache.org/jira/browse/HUDI-9675
             Project: Apache Hudi
          Issue Type: Bug
            Reporter: Timothy Brown


{{}}
You can currently savepoint to an invalid commit when the {{KEEP_LATEST_FILE_VERSIONS}} is enabled. The earliest commit to retain will never be set in the clean metadata so the check allows you to savepoint any commit, regardless of whether the files are present.
{{}}

 

{{}}
We should make a very conservative check here and inspect whether there is any clean commit after the instant of interest. If there is and it is not the commit immediately after the commit of interest, then fail.
 



--
This message was sent by Atlassian Jira
(v8.20.10#820010)