[jira] [Created] (HUDI-5505) Compaction NUM_COMMITS policy should only judge completed deltacommit

["HunterXHunter (Jira)" <ji...@apache.org>]

HunterXHunter created HUDI-5505:
-----------------------------------

             Summary: Compaction NUM_COMMITS policy should only judge completed deltacommit
                 Key: HUDI-5505
                 URL: https://issues.apache.org/jira/browse/HUDI-5505
             Project: Apache Hudi
          Issue Type: Improvement
            Reporter: HunterXHunter
         Attachments: image-2023-01-05-13-10-57-918.png

`compaction.delta_commits =1`

 
{code:java}
20230105115229301.deltacommit
20230105115229301.deltacommit.inflight
20230105115229301.deltacommit.requested
20230105115253118.commit
20230105115253118.compaction.inflight
20230105115253118.compaction.requested
20230105115330994.deltacommit.inflight
20230105115330994.deltacommit.requested{code}
The return result of `ScheduleCompactionActionExecutor.needCompact ` is `true`, 

This should not be expected.

 

And In the `Occ` or `lazy clean` mode，this will cause compaction trigger early.

`compaction.delta_commits =3`

 
{code:java}
20230105125650541.deltacommit.inflight
20230105125650541.deltacommit.requested
20230105125715081.deltacommit
20230105125715081.deltacommit.inflight
20230105125715081.deltacommit.requested
20230105130018070.deltacommit.inflight
20230105130018070.deltacommit.requested {code}
 

And compaction will be trigger, this should not be expected.

!image-2023-01-05-13-10-57-918.png|width=699,height=158!

 



--
This message was sent by Atlassian Jira
(v8.20.10#820010)