You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "Qijun Fu (Jira)" <ji...@apache.org> on 2023/02/01 08:57:00 UTC

[jira] [Created] (HUDI-5675) rollback failed because rollbackFailedWrites schedule rollback on concurrent completed instant

Qijun Fu created HUDI-5675:
------------------------------

             Summary: rollback failed because rollbackFailedWrites schedule rollback on concurrent completed instant 
                 Key: HUDI-5675
                 URL: https://issues.apache.org/jira/browse/HUDI-5675
             Project: Apache Hudi
          Issue Type: Bug
            Reporter: Qijun Fu


rollbackFailedWrites now will get all inflight instants excluding compaction and clustering 

and rollback expired instants in them. However, for concurrent write, an instant can be included in infight instants and become completed before checking whether its heartbeat is expired. And then the completed instant be rollbacked which will cause data loss (For marker based rollback strategy, rollback will fail because we can't rollback an completed instant using marker). 

 

An pr will be issued to solve the problem



--
This message was sent by Atlassian Jira
(v8.20.10#820010)