You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@ozone.apache.org by "Hemant Kumar (Jira)" <ji...@apache.org> on 2023/08/21 21:50:00 UTC

[jira] [Commented] (HDDS-8316) SnapDiff: Persistent collection optimization

    [ https://issues.apache.org/jira/browse/HDDS-8316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17757103#comment-17757103 ] 

Hemant Kumar commented on HDDS-8316:
------------------------------------

If you do https://issues.apache.org/jira/browse/HDDS-9154 optimization, we can revisit it and see if it is needed.

> SnapDiff: Persistent collection optimization
> --------------------------------------------
>
>                 Key: HDDS-8316
>                 URL: https://issues.apache.org/jira/browse/HDDS-8316
>             Project: Apache Ozone
>          Issue Type: Sub-task
>            Reporter: Hemant Kumar
>            Assignee: Hemant Kumar
>            Priority: Minor
>
> To store the snapDiff and intermediate objects, we implemented persistent collections (List, Map, Set) backed by RocksDB. Currently we do individual RocksDb put for every add/put operation to the collection. Which results to lots of I/O. We can optimize it by using WriteBatch and do batch updates of like 1000 entries.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@ozone.apache.org
For additional commands, e-mail: issues-help@ozone.apache.org