You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@ozone.apache.org by "runzhiwang (Jira)" <ji...@apache.org> on 2020/11/20 09:53:00 UTC

[jira] [Resolved] (HDDS-4488) Open RocksDB read only when loading containers

     [ https://issues.apache.org/jira/browse/HDDS-4488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

runzhiwang resolved HDDS-4488.
------------------------------
    Resolution: Fixed

> Open RocksDB read only when loading containers
> ----------------------------------------------
>
>                 Key: HDDS-4488
>                 URL: https://issues.apache.org/jira/browse/HDDS-4488
>             Project: Hadoop Distributed Data Store
>          Issue Type: Improvement
>          Components: Ozone Datanode
>    Affects Versions: 1.1.0
>            Reporter: Stephen O'Donnell
>            Assignee: Stephen O'Donnell
>            Priority: Major
>              Labels: pull-request-available
>
> When a datanode is started, it must read some metadata from all the Containers. Part of that metadata is stored in RocksDB, so the startup process involves opening each rocksDB and closing it again.
> Testing on a dense node, with 45 high performance spinning disks and 200K containers, I saw about 75ms on average to open each RockDB. Further testing demonstrated that if we open RockDB read only, the average open time is about 35ms.
> At startup time, the DBs are only read and never written, so opening read only is fine. HDDS-4427 already ensures these opened DBs are not cached.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@ozone.apache.org
For additional commands, e-mail: issues-help@ozone.apache.org