You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@hudi.apache.org by "sivabalan narayanan (Jira)" <ji...@apache.org> on 2022/01/23 20:12:00 UTC

[jira] [Commented] (HUDI-1517) Create marker file for every log file

    [ https://issues.apache.org/jira/browse/HUDI-1517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17480727#comment-17480727 ] 

sivabalan narayanan commented on HUDI-1517:
-------------------------------------------

[~vinoth] : Do you think we need to pick this up for 0.11 ? 

> Create marker file for every log file
> -------------------------------------
>
>                 Key: HUDI-1517
>                 URL: https://issues.apache.org/jira/browse/HUDI-1517
>             Project: Apache Hudi
>          Issue Type: Improvement
>          Components: writer-core
>            Reporter: sivabalan narayanan
>            Priority: Major
>
> As of now, hudi creates marker file based on base file. But we might need to fix this to create one marker file per log file denoting the actual log file info. We can leverage this during metadata sync w/ rollback and restore rather than doing a file listing. 



--
This message was sent by Atlassian Jira
(v8.20.1#820001)