You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@hudi.apache.org by "hd zhou (Jira)" <ji...@apache.org> on 2022/03/14 09:30:00 UTC

[jira] [Created] (HUDI-3618) flink schedule more compactions at once

hd zhou created HUDI-3618:
-----------------------------

             Summary: flink schedule more compactions at once 
                 Key: HUDI-3618
                 URL: https://issues.apache.org/jira/browse/HUDI-3618
             Project: Apache Hudi
          Issue Type: Improvement
            Reporter: hd zhou


flink  CompactionPlanOperator schedule compaction at notifyCheckpointComplete that can only schedule one compaction every checkpoint.

when compaction rollback, compaction will later then compaction plan ,and cannot catch up with compaction plan create rate。eg: if compaction rollback 3 times, there will be 3 compaction plan pending schedule.

hudi table (RO) look like delay , and more compactions rollback  , much longer  hudi table dely, never catch up.

maybe we can make CompactionPlanOperator schedule more compactions at once

 



--
This message was sent by Atlassian Jira
(v8.20.1#820001)