You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@hudi.apache.org by "ASF GitHub Bot (Jira)" <ji...@apache.org> on 2023/10/19 10:00:00 UTC

[jira] [Updated] (HUDI-6959) Do not rollback current instant when bulk insert as row failed

     [ https://issues.apache.org/jira/browse/HUDI-6959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

ASF GitHub Bot updated HUDI-6959:
---------------------------------
    Labels: pull-request-available  (was: )

> Do not rollback current instant when bulk insert as row failed
> --------------------------------------------------------------
>
>                 Key: HUDI-6959
>                 URL: https://issues.apache.org/jira/browse/HUDI-6959
>             Project: Apache Hudi
>          Issue Type: Bug
>          Components: spark
>            Reporter: Qijun Fu
>            Priority: Major
>              Labels: pull-request-available
>
> When org.apache.hudi.spark3.internal.HoodieDataSourceInternalBatchWrite#abort is called, all the subtasks may not have already been canceled. So if we rollback current instant immediately, there may be new files been written after rollback scheduled, which will cause dirty data.
>  
> We should rollback the failed instant using common mechanism eager and lazy 



--
This message was sent by Atlassian Jira
(v8.20.10#820010)