[jira] [Created] (HDDS-4488) Open RocksDB read only when loading containers

["Stephen O'Donnell (Jira)" <ji...@apache.org>]

Stephen O'Donnell created HDDS-4488:
---------------------------------------

             Summary: Open RocksDB read only when loading containers
                 Key: HDDS-4488
                 URL: https://issues.apache.org/jira/browse/HDDS-4488
             Project: Hadoop Distributed Data Store
          Issue Type: Improvement
          Components: Ozone Datanode
    Affects Versions: 1.1.0
            Reporter: Stephen O'Donnell
            Assignee: Stephen O'Donnell


When a datanode is started, it must read some metadata from all the Containers. Part of that metadata is stored in RocksDB, so the startup process involves opening each rocksDB and closing it again.

Testing on a dense node, with 45 high performance spinning disks and 200K containers, I saw about 75ms on average to open each RockDB. Further testing demonstrated that if we open RockDB read only, the average open time is about 35ms.

At startup time, the DBs are only read and never written, so opening read only is fine. HDDS-4427 already ensures these opened DBs are not cached.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@ozone.apache.org
For additional commands, e-mail: issues-help@ozone.apache.org