You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@hudi.apache.org by "Danny Chen (Jira)" <ji...@apache.org> on 2023/01/05 11:22:00 UTC

[jira] [Updated] (HUDI-5172) Handle empty or corrupted timeline files in data table while constructing valid instants for metadata table read

     [ https://issues.apache.org/jira/browse/HUDI-5172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Danny Chen updated HUDI-5172:
-----------------------------
    Sprint:   (was: )

> Handle empty or corrupted timeline files in data table while constructing valid instants for metadata table read
> ----------------------------------------------------------------------------------------------------------------
>
>                 Key: HUDI-5172
>                 URL: https://issues.apache.org/jira/browse/HUDI-5172
>             Project: Apache Hudi
>          Issue Type: Bug
>          Components: metadata
>            Reporter: sivabalan narayanan
>            Assignee: sivabalan narayanan
>            Priority: Critical
>             Fix For: 0.13.0
>
>
> while reading metadata table, we always poll data timeline to ensure we read only valid instants. there are chances that some meta files are corrupted in such scenarios (atleast in hdfs) and might fail the read from metadata table. 
>  
> We might need to put in a proper fix around this. 



--
This message was sent by Atlassian Jira
(v8.20.10#820010)