You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@hudi.apache.org by "sivabalan narayanan (Jira)" <ji...@apache.org> on 2022/01/05 22:27:00 UTC

[jira] [Updated] (HUDI-3180) Include only files belonging to completed commits while bootstrapping metadata table

     [ https://issues.apache.org/jira/browse/HUDI-3180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

sivabalan narayanan updated HUDI-3180:
--------------------------------------
    Summary: Include only files belonging to completed commits while bootstrapping metadata table  (was: Consider files belonging to completed commits while bootstrapping metadata table)

> Include only files belonging to completed commits while bootstrapping metadata table
> ------------------------------------------------------------------------------------
>
>                 Key: HUDI-3180
>                 URL: https://issues.apache.org/jira/browse/HUDI-3180
>             Project: Apache Hudi
>          Issue Type: Task
>          Components: Writer Core
>            Reporter: sivabalan narayanan
>            Priority: Major
>              Labels: sev:critical
>             Fix For: 0.11.0, 0.10.1
>
>
> metadata table bootstrap does not filter for completed commit files, but all files based on fs.list call. We should filter out files that are part of an ongoing commit while doing bootstrap. 



--
This message was sent by Atlassian Jira
(v8.20.1#820001)