You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@hudi.apache.org by "Prashant Wason (Jira)" <ji...@apache.org> on 2023/04/28 22:14:00 UTC

[jira] [Created] (HUDI-6151) Rollback previously applied commits to MDT when operations are retried.

Prashant Wason created HUDI-6151:
------------------------------------

             Summary: Rollback previously applied commits to MDT when operations are retried.
                 Key: HUDI-6151
                 URL: https://issues.apache.org/jira/browse/HUDI-6151
             Project: Apache Hudi
          Issue Type: Bug
            Reporter: Prashant Wason
            Assignee: Prashant Wason


Operations like Clean, Compaction are retried after failures with the same instant time. If the previous run of the operation successfully committed to the MDT but failed to commit to the dataset, then the operation will be retried later with the same instantTime causing duplicate updates applied to MDT.

Currently, we simply delete the completed deltacommit without rolling back the deltacommit.

To handle this, we detect a replay of operation and rollback any changes from that operation in MDT.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)