You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@hudi.apache.org by "Hui An (Jira)" <ji...@apache.org> on 2023/10/26 04:54:00 UTC

[jira] [Assigned] (HUDI-6989) Stop handling more data if task is aborted & clean partial files if possible in task side

     [ https://issues.apache.org/jira/browse/HUDI-6989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Hui An reassigned HUDI-6989:
----------------------------

    Assignee: Hui An

> Stop handling more data if task is aborted & clean partial files if possible in task side
> -----------------------------------------------------------------------------------------
>
>                 Key: HUDI-6989
>                 URL: https://issues.apache.org/jira/browse/HUDI-6989
>             Project: Apache Hudi
>          Issue Type: Improvement
>            Reporter: Hui An
>            Assignee: Hui An
>            Priority: Major
>              Labels: pull-request-available
>
> Spark would set interrupt status in TaskContext if the task is aborted, HUDI needs to respect that to stop immediately. Also, we can clean partial files at task side to ensure these files won't be left.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)