You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@ozone.apache.org by "Swaminathan Balachandran (Jira)" <ji...@apache.org> on 2025/05/09 15:34:00 UTC
[jira] [Updated] (HDDS-13011) Disable Snapshot DAG Pruner Thread
[ https://issues.apache.org/jira/browse/HDDS-13011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Swaminathan Balachandran updated HDDS-13011:
--------------------------------------------
Description:
After snapshot compaction it can so happen that the sst file may not exist in the snapshot. since the LSM tree structure of the snapshots would have changed though the contents of the rocksdb is the same. Thus we have to disable the DAG pruner which deletes output sst files and change snapshot diff to look for the delta sst file in the AOS rocksdb directory and then look at the backup sst file directory in the same order for creating a hardlink for the delta sst files instead of looking at source and target snapshot.
[https://github.com/apache/ozone/blob/413538480154dba6199fcfb95545a0849488af77/hadoop-hdds/rocksdb-checkpoint-differ/src/main/java/org/apache/ozone/rocksdiff/RocksDBCheckpointDiffer.java#L771]
was:After snapshot compaction it can so happen that the sst file may not exist in the snapshot. since the LSM tree structure of the snapshots would have changed though the contents of the rocksdb is the same. Thus we have to disable the DAG pruner which deletes output sst files and change snapshot diff to look for the delta sst file in the AOS rocksdb directory and then look at the backup sst file directory in the same order for creating a hardlink for the delta sst files.
> Disable Snapshot DAG Pruner Thread
> ----------------------------------
>
> Key: HDDS-13011
> URL: https://issues.apache.org/jira/browse/HDDS-13011
> Project: Apache Ozone
> Issue Type: Sub-task
> Reporter: Swaminathan Balachandran
> Priority: Major
>
> After snapshot compaction it can so happen that the sst file may not exist in the snapshot. since the LSM tree structure of the snapshots would have changed though the contents of the rocksdb is the same. Thus we have to disable the DAG pruner which deletes output sst files and change snapshot diff to look for the delta sst file in the AOS rocksdb directory and then look at the backup sst file directory in the same order for creating a hardlink for the delta sst files instead of looking at source and target snapshot.
> [https://github.com/apache/ozone/blob/413538480154dba6199fcfb95545a0849488af77/hadoop-hdds/rocksdb-checkpoint-differ/src/main/java/org/apache/ozone/rocksdiff/RocksDBCheckpointDiffer.java#L771]
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@ozone.apache.org
For additional commands, e-mail: issues-help@ozone.apache.org