You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@ozone.apache.org by "Janus Chow (Jira)" <ji...@apache.org> on 2021/07/21 10:18:00 UTC

[jira] [Created] (HDDS-5472) Old versions of location in OmKeyLocationInfoGroup causes OOM of OM

Janus Chow created HDDS-5472:
--------------------------------

             Summary: Old versions of location in OmKeyLocationInfoGroup causes OOM of OM
                 Key: HDDS-5472
                 URL: https://issues.apache.org/jira/browse/HDDS-5472
             Project: Apache Ozone
          Issue Type: Improvement
            Reporter: Janus Chow
            Assignee: Janus Chow


Currently the keyLocation of different versions is stored redundantly in OmKeyInfo. 
 * OmKeyInfo:
 ** keyLocationVersions: List<OmKeyLocationInfoGroup>  stores different versions of information in a list.
 * OmKeyLocationInfoGroup:
 **  locationVersionMap: Map<Long, List<OmKeyLocationInfo>> stores different versions of location in a map.

If the versions are large, the redundent location is causing the large GC overhead for OM, in our cluster, the OM even crashes because of OOM.

This ticket is to remove the redundant location information to keep OM healthy.

Attached the OmKeyInfo of a key with 549 versions.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@ozone.apache.org
For additional commands, e-mail: issues-help@ozone.apache.org