You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@hudi.apache.org by "Ethan Guo (Jira)" <ji...@apache.org> on 2024/03/28 00:57:00 UTC

[jira] [Updated] (HUDI-6359) Spark offline compaction/clustering will never rollback when both requested and inflight states exist

     [ https://issues.apache.org/jira/browse/HUDI-6359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Ethan Guo updated HUDI-6359:
----------------------------
    Component/s: clustering
                 compaction
                 table-service

> Spark offline compaction/clustering will never rollback when both requested and inflight states exist
> -----------------------------------------------------------------------------------------------------
>
>                 Key: HUDI-6359
>                 URL: https://issues.apache.org/jira/browse/HUDI-6359
>             Project: Apache Hudi
>          Issue Type: Bug
>          Components: clustering, compaction, table-service
>            Reporter: kwang
>            Priority: Critical
>              Labels: pull-request-available
>             Fix For: 1.1.0
>
>
> If spark offline compaction execution fails, both a.compaction.requested and a.compaction.inflight states exist at the same time, which will cause the next  offline compaction never rolledback for compaction plan a.compaction.requested. Spark offline clustering is same as compaction.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)