[jira] [Commented] (HBASE-15555) Memory Management

["Anoop Sam John (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/HBASE-15555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15222161#comment-15222161 ] 

Anoop Sam John commented on HBASE-15555:
----------------------------------------

Some update here.
After some tuning with SurvivorRatio, we are able to get almost same avg GC pause time and reduced #GC pauses, when the reqs read into BBs that we get from BBBpool..    So these are off heap BBs.   We have extended PB to support offheap BB.   Also we have done an impl of Offheap MSLAB.  Will give more test results soon.

> Memory Management
> -----------------
>
>                 Key: HBASE-15555
>                 URL: https://issues.apache.org/jira/browse/HBASE-15555
>             Project: HBase
>          Issue Type: Umbrella
>            Reporter: stack
>         Attachments: download.svg
>
>
> Umbrella issue on memory management. One-stop shop to learn how we're doing it, tenets, and work to be done. Collect it all in one place so we are aligned rather than each trying to do it for themselves.
> Subtasks include:
> + Map of memory allocation and recycling landscape
> + Where are we allocating when we could be recycling
> + MSLAB and G1GC don't go together?
> + Enable MSLAB pool always?
> + With offheap allocations, less GC but it runs for longer?
> + Better heuristics recycling: e.g. HBASE-15525 OutOfMemory could occur when using BoundedByteBufferPool during RPC bursts
> + See if can do DFSClient buffer reuse: HBASE-15506 FSDataOutputStream.write() allocates new byte buffer on each operation
> What else?



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)