You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@hudi.apache.org by "sivabalan narayanan (Jira)" <ji...@apache.org> on 2021/09/15 13:21:00 UTC

[jira] [Created] (HUDI-2436) rollback in cloud stores w/o append, wrt collecting log files to be deleted/logged

sivabalan narayanan created HUDI-2436:
-----------------------------------------

             Summary: rollback in cloud stores w/o append, wrt collecting log files to be deleted/logged
                 Key: HUDI-2436
                 URL: https://issues.apache.org/jira/browse/HUDI-2436
             Project: Apache Hudi
          Issue Type: Improvement
          Components: Writer Core
            Reporter: sivabalan narayanan
             Fix For: 0.10.0


In cloud stores that does not support append, if there was a crash during writing to a log file. and later rollback was triggered for this failed commit, this last log file may not be returned when listing all log files written for this commit of interest. but is there a chance that log files that the rollback is committed/logged, uses the same log file name as the one that got failed? 

 

- with hdfs type of cloud stores, where appends are allowed, we just create new log blocks. and hence should not be an issue. 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)