You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "ASF GitHub Bot (Jira)" <ji...@apache.org> on 2023/04/28 22:27:00 UTC

[jira] [Updated] (HUDI-6151) Rollback previously applied commits to MDT when operations are retried.

     [ https://issues.apache.org/jira/browse/HUDI-6151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

ASF GitHub Bot updated HUDI-6151:
---------------------------------
    Labels: pull-request-available  (was: )

> Rollback previously applied commits to MDT when operations are retried.
> -----------------------------------------------------------------------
>
>                 Key: HUDI-6151
>                 URL: https://issues.apache.org/jira/browse/HUDI-6151
>             Project: Apache Hudi
>          Issue Type: Bug
>            Reporter: Prashant Wason
>            Assignee: Prashant Wason
>            Priority: Major
>              Labels: pull-request-available
>
> Operations like Clean, Compaction are retried after failures with the same instant time. If the previous run of the operation successfully committed to the MDT but failed to commit to the dataset, then the operation will be retried later with the same instantTime causing duplicate updates applied to MDT.
> Currently, we simply delete the completed deltacommit without rolling back the deltacommit.
> To handle this, we detect a replay of operation and rollback any changes from that operation in MDT.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)