[jira] [Updated] (HUDI-1517) Create marker file for every log file

["Ethan Guo (Jira)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/HUDI-1517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Ethan Guo updated HUDI-1517:
----------------------------
    Fix Version/s: 0.15.0
                   1.0.0
                       (was: 1.1.0)

> Create marker file for every log file
> -------------------------------------
>
>                 Key: HUDI-1517
>                 URL: https://issues.apache.org/jira/browse/HUDI-1517
>             Project: Apache Hudi
>          Issue Type: Improvement
>          Components: writer-core
>            Reporter: sivabalan narayanan
>            Assignee: ZiyueGuan
>            Priority: Major
>              Labels: pull-request-available
>             Fix For: 0.15.0, 1.0.0
>
>   Original Estimate: 2h
>  Remaining Estimate: 2h
>
> As of now, hudi creates marker file based on base file. But we might need to fix this to create one marker file per log file denoting the actual log file info. We can leverage this during metadata sync w/ rollback and restore rather than doing a file listing. 



--
This message was sent by Atlassian Jira
(v8.20.10#820010)