[jira] [Commented] (HDDS-3626) Limit the off-heap memory of RocksDB in datanode

["Siyao Meng (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/HDDS-3626?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17757613#comment-17757613 ] 

Siyao Meng commented on HDDS-3626:
----------------------------------

Block size might be the main one we need to look at in regards to RocksDB tunables:

{code}
table_options.block_cache
{code}

https://github.com/facebook/rocksdb/wiki/Memory-usage-in-RocksDB

> Limit the off-heap memory of RocksDB in datanode
> ------------------------------------------------
>
>                 Key: HDDS-3626
>                 URL: https://issues.apache.org/jira/browse/HDDS-3626
>             Project: Apache Ozone
>          Issue Type: Sub-task
>            Reporter: runzhiwang
>            Assignee: runzhiwang
>            Priority: Major
>         Attachments: image-2020-05-20-17-07-30-542.png
>
>
> Datanode occupy 5.2GB physical memory, Xmx is 2200m, MaxDirectMemorySize is 800m, so there is at least 2.2GB  memory occupied by RocksDB. I also track the memory allocated in datanode, you can find RocksDB allocate 74.2% of the total memory.
>  !image-2020-05-20-17-07-30-542.png! 



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@ozone.apache.org
For additional commands, e-mail: issues-help@ozone.apache.org