[jira] [Created] (HUDI-8385) Apply clean commits to col stats partition on restore in data table

["sivabalan narayanan (Jira)" <ji...@apache.org>]

sivabalan narayanan created HUDI-8385:
-----------------------------------------

             Summary: Apply clean commits to col stats partition on restore in data table
                 Key: HUDI-8385
                 URL: https://issues.apache.org/jira/browse/HUDI-8385
             Project: Apache Hudi
          Issue Type: Improvement
          Components: metadata
            Reporter: sivabalan narayanan


When we trigger restore in data table, we do the following: 
 * we restore the MDT also to the same instant as data table.
 * For clean commits which could not be reverted in data table, we find the difference b/w fs based listing and MDT based listing and add a delta commit to FILES partition to clean those files. 

 

but no other indexes are updated here. 

We might need to update col stats as well. Similar to how we delete files from FILES partition, we should also delete entries from col stats partition. 

 

 



--
This message was sent by Atlassian Jira
(v8.20.10#820010)