You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@hudi.apache.org by "sivabalan narayanan (Jira)" <ji...@apache.org> on 2021/01/09 19:37:00 UTC

[jira] [Created] (HUDI-1517) Create marker file for every log file

sivabalan narayanan created HUDI-1517:
-----------------------------------------

             Summary: Create marker file for every log file
                 Key: HUDI-1517
                 URL: https://issues.apache.org/jira/browse/HUDI-1517
             Project: Apache Hudi
          Issue Type: Improvement
          Components: Writer Core
            Reporter: sivabalan narayanan


As of now, hudi creates marker file based on base file. But we might need to fix this to create one marker file per log file denoting the actual log file info. We can leverage this during metadata sync w/ rollback and restore rather than doing a file listing. 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)