You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@ozone.apache.org by "Prashant Pogde (Jira)" <ji...@apache.org> on 2023/07/11 20:09:00 UTC

[jira] [Resolved] (HDDS-8943) Limit the total size of sst files in bootstrapping tarball.

     [ https://issues.apache.org/jira/browse/HDDS-8943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Prashant Pogde resolved HDDS-8943.
----------------------------------
    Resolution: Fixed

> Limit the total size of sst files in bootstrapping tarball.
> -----------------------------------------------------------
>
>                 Key: HDDS-8943
>                 URL: https://issues.apache.org/jira/browse/HDDS-8943
>             Project: Apache Ozone
>          Issue Type: Sub-task
>            Reporter: George Jahad
>            Assignee: George Jahad
>            Priority: Major
>              Labels: pull-request-available
>
> The incremental checkpointing PR I created here: https://github.com/apache/ozone/pull/4770 allows multiple increments of data if the initial tarball took too long to download.
> This is needed for om snapshots but is not completely sufficient, because the first increment can grow quite large, as it includes all sst files that exist at the time it is created.  (Each subsequent increment only includes the sst files created after the first tarball was created.)
> This means there is no limit to the size of the inital tarball.  
>  
> The purpose of this ticket is to address that issue.
> Note that this is a relatively small enhancement to the existing incremental checkpointing feature; I already have it working, and should be able to create a PR in the next few days.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@ozone.apache.org
For additional commands, e-mail: issues-help@ozone.apache.org