You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@hudi.apache.org by "Prashant Wason (Jira)" <ji...@apache.org> on 2023/04/18 22:46:00 UTC

[jira] [Created] (HUDI-6101) Corrected the compaction strategy to use for MDT

Prashant Wason created HUDI-6101:
------------------------------------

             Summary: Corrected the compaction strategy to use for MDT
                 Key: HUDI-6101
                 URL: https://issues.apache.org/jira/browse/HUDI-6101
             Project: Apache Hudi
          Issue Type: Bug
            Reporter: Prashant Wason
            Assignee: Prashant Wason


Metadata table requires all file slices and all partitions to be compacted at same time. 

 

Compaction on metadata table is used as a barrier for archiving on main dataset and for validating the deltacommits having corresponding completed commits. Therefore, we need to compact all fileslices of all partitions together requiring UnBoundedCompactionStrategy.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)