You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@hudi.apache.org by "Yue Zhang (Jira)" <ji...@apache.org> on 2021/11/23 02:33:00 UTC

[jira] [Created] (HUDI-2833) Clean up unused archive files instead of expanding indefinitely

Yue Zhang created HUDI-2833:
-------------------------------

             Summary: Clean up unused archive files instead of expanding indefinitely
                 Key: HUDI-2833
                 URL: https://issues.apache.org/jira/browse/HUDI-2833
             Project: Apache Hudi
          Issue Type: Task
            Reporter: Yue Zhang


As we know, most of storage do not support append action, so that hoodie will create a new archive file under archived dictionary when archiving.

As time goes by, there may be thousands of archive files, which most of them is not useful anymore.

Maybe it is meaningful to have a function to clean these unused archive files.



--
This message was sent by Atlassian Jira
(v8.20.1#820001)