[jira] [Commented] (HUDI-1517) Create marker file for every log file

["Jing Zhang (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/HUDI-1517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17760198#comment-17760198 ] 

Jing Zhang commented on HUDI-1517:
----------------------------------

The commit [#4913|https://github.com/apache/hudi/pull/4913] is reverted. Refer to [#9090|https://github.com/apache/hudi/issues/9090] for more info about why this needs to be reverted.
And would go back to solve this problem in 1.0.0, the track issue is [HUDI-6803|https://issues.apache.org/jira/browse/HUDI-6803].

> Create marker file for every log file
> -------------------------------------
>
>                 Key: HUDI-1517
>                 URL: https://issues.apache.org/jira/browse/HUDI-1517
>             Project: Apache Hudi
>          Issue Type: Improvement
>          Components: writer-core
>            Reporter: sivabalan narayanan
>            Assignee: ZiyueGuan
>            Priority: Major
>              Labels: pull-request-available
>             Fix For: 1.0.0
>
>   Original Estimate: 2h
>  Remaining Estimate: 2h
>
> As of now, hudi creates marker file based on base file. But we might need to fix this to create one marker file per log file denoting the actual log file info. We can leverage this during metadata sync w/ rollback and restore rather than doing a file listing. 



--
This message was sent by Atlassian Jira
(v8.20.10#820010)