[jira] [Updated] (HDDS-9154) Optimize Snapdiff to compute diff from Delta SST Files directly

["Saketa Chalamchala (Jira)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/HDDS-9154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Saketa Chalamchala updated HDDS-9154:
-------------------------------------
    Summary: Optimize Snapdiff to compute diff from Delta SST Files directly  (was: Optimize Snapdiff to compute diff from Delta SST Files in case of DAG based Diff)

> Optimize Snapdiff to compute diff from Delta SST Files directly
> ---------------------------------------------------------------
>
>                 Key: HDDS-9154
>                 URL: https://issues.apache.org/jira/browse/HDDS-9154
>             Project: Apache Ozone
>          Issue Type: Sub-task
>            Reporter: Swaminathan Balachandran
>            Assignee: Saketa Chalamchala
>            Priority: Critical
>
> The current Snapshot Diff (SnapDiff) mechanism identifies changes between snapshots by constructing a reverse object ID mapping, a process that requires intensive I/O to read Delta SST files and perform cross-database lookups between the source and target snapshot RocksDB instances.
> To improve efficiency, the diff engine can be redesigned to compute differences by directly scanning the internal contents of the SST files. By evaluating the RocksDB sequence numbers and values embedded within the SST entries, the system can determine key mutations without the need for exhaustive mapping or external lookups.
> This transition from a mapping-centric approach to a direct metadata-driven analysis significantly minimizes IOPS, drastically reducing the latency and resource consumption of the SnapDiff computation.
>  
>  



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@ozone.apache.org
For additional commands, e-mail: issues-help@ozone.apache.org