You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@hudi.apache.org by "Ethan Guo (Jira)" <ji...@apache.org> on 2024/03/29 02:24:00 UTC

[jira] [Updated] (HUDI-6989) Stop handling more data if task is aborted & clean partial files if possible in task side

     [ https://issues.apache.org/jira/browse/HUDI-6989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Ethan Guo updated HUDI-6989:
----------------------------
    Component/s: spark

> Stop handling more data if task is aborted & clean partial files if possible in task side
> -----------------------------------------------------------------------------------------
>
>                 Key: HUDI-6989
>                 URL: https://issues.apache.org/jira/browse/HUDI-6989
>             Project: Apache Hudi
>          Issue Type: Improvement
>          Components: spark
>            Reporter: Hui An
>            Assignee: Hui An
>            Priority: Major
>              Labels: pull-request-available
>
> Spark would set interrupt status in TaskContext if the task is aborted, HUDI needs to respect that to stop immediately. Also, we can clean partial files at task side to ensure these files won't be left.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)