You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "sivabalan narayanan (Jira)" <ji...@apache.org> on 2022/09/04 22:04:00 UTC

[jira] [Updated] (HUDI-3954) Don't keep the last commit before the earliest commit to retain

     [ https://issues.apache.org/jira/browse/HUDI-3954?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

sivabalan narayanan updated HUDI-3954:
--------------------------------------
    Story Points: 0.5

> Don't keep the last commit before the earliest commit to retain
> ---------------------------------------------------------------
>
>                 Key: HUDI-3954
>                 URL: https://issues.apache.org/jira/browse/HUDI-3954
>             Project: Apache Hudi
>          Issue Type: Improvement
>          Components: cleaning
>            Reporter: 董可伦
>            Assignee: sivabalan narayanan
>            Priority: Critical
>              Labels: pull-request-available
>             Fix For: 0.12.1
>
>
> Don't keep the last commit before the earliest commit to retain
> According to the document of {{{}hoodie.cleaner.commits.retained{}}}:
> Number of commits to retain, without cleaning. This will be retained for num_of_commits * time_between_commits (scheduled). This also directly translates into how much data retention the table supports for incremental queries.
>  
> We only need to keep the number of commit configured through parameters {{{}hoodie.cleaner.commits.retained{}}}.
> And the commit retained by clean is completed.This ensures that “This will be retained for num_of_commits * time_between_commits” in the document.
> So we don't need to keep the last commit before the earliest commit to retain,If we want to keep more versions, we can increase the parameters {{hoodie.cleaner.commits.retained}}



--
This message was sent by Atlassian Jira
(v8.20.10#820010)