You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@hbase.apache.org by "stack (JIRA)" <ji...@apache.org> on 2018/07/19 22:06:00 UTC

[jira] [Created] (HBASE-20914) Trim Master memory usage

stack created HBASE-20914:
-----------------------------

             Summary: Trim Master memory usage
                 Key: HBASE-20914
                 URL: https://issues.apache.org/jira/browse/HBASE-20914
             Project: HBase
          Issue Type: Sub-task
          Components: master
            Reporter: stack
            Assignee: stack
             Fix For: 2.0.2


While working on the parent issue, looking at a heap from a Master tha was running ~650 servers and > 300k regions, I tripped over some silly items in the heap:

1. Balancer has a regions x server matrix which takes up 18% of the Master heap according to jxray and 40% according to eclipse. Looks like the matrix should be regions x racks which would be much smaller (Issue came in with HBASE-18164 Fast locality computation in balancer  -Added new LocalityCostFunction and LocalityCandidateGenerator ..).

2. Duplicate Strings make up ~5% of the Master heap. Of these, ServerName seems to be the font. Interesting is report that there 54k instances of ServerName in this heap though there are only 650 Servers.

3. ArrayDequeue initializes its internal elements array with 16 elements. We use this in a few places. In Procedures, of which there are many in this heap, we near never make use of this array.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)