[jira] [Updated] (HUDI-8507) Ensure false positive failures from MDT validations are accounted for

["Lin Liu (Jira)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/HUDI-8507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Lin Liu updated HUDI-8507:
--------------------------
    Status: In Progress  (was: Open)

> Ensure false positive failures from MDT validations are accounted for
> ---------------------------------------------------------------------
>
>                 Key: HUDI-8507
>                 URL: https://issues.apache.org/jira/browse/HUDI-8507
>             Project: Apache Hudi
>          Issue Type: Improvement
>          Components: metadata
>            Reporter: sivabalan narayanan
>            Assignee: Lin Liu
>            Priority: Critical
>             Fix For: 1.0.0
>
>   Original Estimate: 6h
>  Remaining Estimate: 6h
>
> We fixed couple of false positive validation failure cases for FILES partition and RLI in 
> HoodieMetadataTableValidator. 
> Ref [https://github.com/apache/hudi/pull/11098] 
>  
> essentially, in b/w the time we poll fs based view and MDT view, there could be additional commits in MDT. so, we need to account for them in our validation. 
>  
> Lets ensure we account for the same for other partitions like 
> col stats, bloom filter, functional index, sec index and partition stats index. 



--
This message was sent by Atlassian Jira
(v8.20.10#820010)