You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "Ethan Guo (Jira)" <ji...@apache.org> on 2023/02/07 22:53:00 UTC

[jira] [Updated] (HUDI-3954) Don't keep the last commit before the earliest commit to retain

     [ https://issues.apache.org/jira/browse/HUDI-3954?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Ethan Guo updated HUDI-3954:
----------------------------
    Fix Version/s: 0.14.0
                       (was: 0.13.0)

> Don't keep the last commit before the earliest commit to retain
> ---------------------------------------------------------------
>
>                 Key: HUDI-3954
>                 URL: https://issues.apache.org/jira/browse/HUDI-3954
>             Project: Apache Hudi
>          Issue Type: Improvement
>          Components: cleaning
>            Reporter: 董可伦
>            Assignee: sivabalan narayanan
>            Priority: Critical
>              Labels: pull-request-available
>             Fix For: 0.14.0
>
>
> Don't keep the last commit before the earliest commit to retain
> According to the document of {{{}hoodie.cleaner.commits.retained{}}}:
> Number of commits to retain, without cleaning. This will be retained for num_of_commits * time_between_commits (scheduled). This also directly translates into how much data retention the table supports for incremental queries.
>  
> We only need to keep the number of commit configured through parameters {{{}hoodie.cleaner.commits.retained{}}}.
> And the commit retained by clean is completed.This ensures that “This will be retained for num_of_commits * time_between_commits” in the document.
> So we don't need to keep the last commit before the earliest commit to retain,If we want to keep more versions, we can increase the parameters {{hoodie.cleaner.commits.retained}}



--
This message was sent by Atlassian Jira
(v8.20.10#820010)