You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@ozone.apache.org by "ASF GitHub Bot (Jira)" <ji...@apache.org> on 2025/10/17 18:12:00 UTC
[jira] [Updated] (HDDS-13770) SstBackup Directory can have orphan files after bootstrap not present in compaction log table
[ https://issues.apache.org/jira/browse/HDDS-13770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
ASF GitHub Bot updated HDDS-13770:
----------------------------------
Labels: pull-request-available (was: )
> SstBackup Directory can have orphan files after bootstrap not present in compaction log table
> ---------------------------------------------------------------------------------------------
>
> Key: HDDS-13770
> URL: https://issues.apache.org/jira/browse/HDDS-13770
> Project: Apache Ozone
> Issue Type: Sub-task
> Reporter: Swaminathan Balachandran
> Assignee: Wei-Chiu Chuang
> Priority: Major
> Labels: pull-request-available
>
> Currently links from sst backup directory are created after the AOS rocksdb checkpoint is taken this can lead to having orphan sstFiles in backupSstFile directory since compactions could happen right after the checkpoints taken.
> https://github.com/apache/ozone/blob/bc731ea6af706fd51eedbc31bd1eeea0bd75c4ee/hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/OMDBCheckpointServletInodeBasedXfer.java#L489
> Rather than creating new file links the compaction log table needs to be iterated from the compaction log table in checkpointed rocksdb to get the concrete set of files that need to be copied and creating file links can be completely avoided.
> Redundantly copying compaction log files can also be avoided in this case.(BTW there should be no compaction log files in the fileSystem anywhere since the compaction entries would already have been loaded into compactionLogTable).
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@ozone.apache.org
For additional commands, e-mail: issues-help@ozone.apache.org