You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "Ethan Guo (Jira)" <ji...@apache.org> on 2024/03/29 01:07:00 UTC
[jira] [Updated] (HUDI-4725) Add inorder commit for multi compaction plan
[ https://issues.apache.org/jira/browse/HUDI-4725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Ethan Guo updated HUDI-4725:
----------------------------
Component/s: table-service
> Add inorder commit for multi compaction plan
> --------------------------------------------
>
> Key: HUDI-4725
> URL: https://issues.apache.org/jira/browse/HUDI-4725
> Project: Apache Hudi
> Issue Type: Improvement
> Components: compaction, table-service
> Reporter: Tan Yajun
> Assignee: Tan Yajun
> Priority: Major
> Original Estimate: 2h
> Remaining Estimate: 2h
>
> When we use the multi plan compaction,we may need the plan to commit in order,so I try to figure that by create a set to store the instant that are not ready,and I transform the compactionPlans(List of Pair<String(instant),compactionPlan>) to the sinkFunction.When a commit is ready,I remove the instant from the noReadyCache,and I will check that if it the earliest compaction need to commit, if that commit the compaction instant and check if the next one is ready and commit.if it's not the earliest one, just remove its instant from the noReadyCache.
>
> [https://github.com/apache/hudi/pull/6512]
--
This message was sent by Atlassian Jira
(v8.20.10#820010)