You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@hudi.apache.org by "Hussein Awala (Jira)" <ji...@apache.org> on 2022/10/22 15:10:00 UTC

[jira] [Updated] (HUDI-5053) Create empty clean requested, inflight and complete even if there is none to clean to leverage incremental cealning

     [ https://issues.apache.org/jira/browse/HUDI-5053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Hussein Awala updated HUDI-5053:
--------------------------------
    Status: In Progress  (was: Open)

> Create empty clean requested, inflight and complete even if there is none to clean to leverage incremental cealning
> -------------------------------------------------------------------------------------------------------------------
>
>                 Key: HUDI-5053
>                 URL: https://issues.apache.org/jira/browse/HUDI-5053
>             Project: Apache Hudi
>          Issue Type: Improvement
>          Components: cleaning
>            Reporter: sivabalan narayanan
>            Assignee: Hussein Awala
>            Priority: Major
>
> Ask from user:
> With incremental cleaning mode, is effective only from last clean. But everytime if we check if there is something to clean up and if there is none, even though we have done the work to do some planning, we don't create a clean.requested and get it to completion. So, next time when we come around, we redo the same planning again. But if we have had an empty clean.requested, clean.inflight and clean.complete, we could reduce the computation required. 
>  
> Ref: [https://github.com/apache/hudi/issues/6953]
>  



--
This message was sent by Atlassian Jira
(v8.20.10#820010)