You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@hudi.apache.org by "Qijun Fu (Jira)" <ji...@apache.org> on 2023/02/01 08:57:00 UTC

[jira] [Assigned] (HUDI-5675) rollback failed because rollbackFailedWrites schedule rollback on concurrent completed instant

     [ https://issues.apache.org/jira/browse/HUDI-5675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Qijun Fu reassigned HUDI-5675:
------------------------------

    Assignee: Qijun Fu

> rollback failed because rollbackFailedWrites schedule rollback on concurrent completed instant 
> -----------------------------------------------------------------------------------------------
>
>                 Key: HUDI-5675
>                 URL: https://issues.apache.org/jira/browse/HUDI-5675
>             Project: Apache Hudi
>          Issue Type: Bug
>            Reporter: Qijun Fu
>            Assignee: Qijun Fu
>            Priority: Major
>
> rollbackFailedWrites now will get all inflight instants excluding compaction and clustering 
> and rollback expired instants in them. However, for concurrent write, an instant can be included in infight instants and become completed before checking whether its heartbeat is expired. And then the completed instant be rollbacked which will cause data loss (For marker based rollback strategy, rollback will fail because we can't rollback an completed instant using marker). 
>  
> An pr will be issued to solve the problem



--
This message was sent by Atlassian Jira
(v8.20.10#820010)