[jira] [Created] (HUDI-6351) Long standing replace inflights post completion can be archived before cleaning for KEEP_LATEST_FILE_VERSIONS cleaner policy.

["Surya Prasanna Yalla (Jira)" <ji...@apache.org>]

Surya Prasanna Yalla created HUDI-6351:
------------------------------------------

             Summary: Long standing replace inflights post completion can be archived before cleaning for KEEP_LATEST_FILE_VERSIONS cleaner policy.
                 Key: HUDI-6351
                 URL: https://issues.apache.org/jira/browse/HUDI-6351
             Project: Apache Hudi
          Issue Type: Bug
            Reporter: Surya Prasanna Yalla


For KEEP_LATEST_FILE_VERSIONS cleaner policy, file versions are only maintained for active file groups not for replaced file groups.

Since, earliestCommitToRetain is null for KEEP_LATEST_FILE_VERSIONS policy, last clean instant can be considered as a lower bound, since the cleaner would have removed all the file groups until then. But there is a catch to this logic, while cleaner is running if there is a pending replacecommit then those files are not cleaned.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)