You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@ozone.apache.org by "Sumit Agrawal (Jira)" <ji...@apache.org> on 2023/11/30 03:31:00 UTC

[jira] [Created] (HDDS-9803) limit number of bucket to avoid OOM

Sumit Agrawal created HDDS-9803:
-----------------------------------

             Summary: limit number of bucket to avoid OOM
                 Key: HDDS-9803
                 URL: https://issues.apache.org/jira/browse/HDDS-9803
             Project: Apache Ozone
          Issue Type: Bug
          Components: Ozone Manager
            Reporter: Sumit Agrawal
            Assignee: Sumit Agrawal


When creating a large number of buckets using freon, 27.7 million buckets are created with OM configured with 32GB memory.

 

Since bucket is full cache table, so all bucket information is kept in memory. This is consuming almost all memory of OM.

Further (pause of GC) is happening when OM is about to reach OOM and no more memory available to be freed.

 



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@ozone.apache.org
For additional commands, e-mail: issues-help@ozone.apache.org