You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hbase.apache.org by "Jimmy Xiang (JIRA)" <ji...@apache.org> on 2012/11/03 01:18:12 UTC

[jira] [Created] (HBASE-7092) RegionServer OOM with jdk 1.7 related to ConcurrentHashMap class loader

Jimmy Xiang created HBASE-7092:
----------------------------------

             Summary: RegionServer OOM with jdk 1.7 related to ConcurrentHashMap class loader
                 Key: HBASE-7092
                 URL: https://issues.apache.org/jira/browse/HBASE-7092
             Project: HBase
          Issue Type: Sub-task
            Reporter: Jimmy Xiang


One instance of "java.util.concurrent.ConcurrentHashMap" loaded by "<system class loader>" occupies 3,972,154,848 (92.88%) bytes. The instance is referenced by org.apache.hadoop.hbase.regionserver.HRegionServer @ 0x7038d3798 , loaded by "sun.misc.Launcher$AppClassLoader @ 0x703994668". The memory is accumulated in one instance of "java.util.concurrent.ConcurrentHashMap$Segment[]" loaded by "<system class loader>".

Keywords
sun.misc.Launcher$AppClassLoader @ 0x703994668
java.util.concurrent.ConcurrentHashMap
java.util.concurrent.ConcurrentHashMap$Segment[]

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Updated] (HBASE-7092) RegionServer OOM with jdk 1.7 related to ConcurrentHashMap class loader

Posted by "Jimmy Xiang (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HBASE-7092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Jimmy Xiang updated HBASE-7092:
-------------------------------

    Attachment: heap-dump.png
    
> RegionServer OOM with jdk 1.7 related to ConcurrentHashMap class loader
> -----------------------------------------------------------------------
>
>                 Key: HBASE-7092
>                 URL: https://issues.apache.org/jira/browse/HBASE-7092
>             Project: HBase
>          Issue Type: Sub-task
>            Reporter: Jimmy Xiang
>            Assignee: Jimmy Xiang
>             Fix For: 0.96.0
>
>         Attachments: heap-dump.png
>
>
> One instance of "java.util.concurrent.ConcurrentHashMap" loaded by "<system class loader>" occupies 3,972,154,848 (92.88%) bytes. The instance is referenced by org.apache.hadoop.hbase.regionserver.HRegionServer @ 0x7038d3798 , loaded by "sun.misc.Launcher$AppClassLoader @ 0x703994668". The memory is accumulated in one instance of "java.util.concurrent.ConcurrentHashMap$Segment[]" loaded by "<system class loader>".
> Keywords
> sun.misc.Launcher$AppClassLoader @ 0x703994668
> java.util.concurrent.ConcurrentHashMap
> java.util.concurrent.ConcurrentHashMap$Segment[]

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HBASE-7092) RegionServer OOM with jdk 1.7 related to ConcurrentHashMap class loader

Posted by "stack (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HBASE-7092?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13489908#comment-13489908 ] 

stack commented on HBASE-7092:
------------------------------

You have a heap dump Jimmy that we could take a look at ?  What jdk1.7 version?
                
> RegionServer OOM with jdk 1.7 related to ConcurrentHashMap class loader
> -----------------------------------------------------------------------
>
>                 Key: HBASE-7092
>                 URL: https://issues.apache.org/jira/browse/HBASE-7092
>             Project: HBase
>          Issue Type: Sub-task
>            Reporter: Jimmy Xiang
>            Assignee: Jimmy Xiang
>             Fix For: 0.96.0
>
>
> One instance of "java.util.concurrent.ConcurrentHashMap" loaded by "<system class loader>" occupies 3,972,154,848 (92.88%) bytes. The instance is referenced by org.apache.hadoop.hbase.regionserver.HRegionServer @ 0x7038d3798 , loaded by "sun.misc.Launcher$AppClassLoader @ 0x703994668". The memory is accumulated in one instance of "java.util.concurrent.ConcurrentHashMap$Segment[]" loaded by "<system class loader>".
> Keywords
> sun.misc.Launcher$AppClassLoader @ 0x703994668
> java.util.concurrent.ConcurrentHashMap
> java.util.concurrent.ConcurrentHashMap$Segment[]

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Updated] (HBASE-7092) RegionServer OOM related to onlineregions

Posted by "Jimmy Xiang (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HBASE-7092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Jimmy Xiang updated HBASE-7092:
-------------------------------

    Priority: Blocker  (was: Major)
    
> RegionServer OOM related to onlineregions
> -----------------------------------------
>
>                 Key: HBASE-7092
>                 URL: https://issues.apache.org/jira/browse/HBASE-7092
>             Project: HBase
>          Issue Type: Bug
>            Reporter: Jimmy Xiang
>            Assignee: Jimmy Xiang
>            Priority: Blocker
>             Fix For: 0.96.0
>
>         Attachments: heap-dump.png
>
>
> One instance of "java.util.concurrent.ConcurrentHashMap" loaded by "<system class loader>" occupies 3,972,154,848 (92.88%) bytes. The instance is referenced by org.apache.hadoop.hbase.regionserver.HRegionServer @ 0x7038d3798 , loaded by "sun.misc.Launcher$AppClassLoader @ 0x703994668". The memory is accumulated in one instance of "java.util.concurrent.ConcurrentHashMap$Segment[]" loaded by "<system class loader>".
> Keywords
> sun.misc.Launcher$AppClassLoader @ 0x703994668
> java.util.concurrent.ConcurrentHashMap
> java.util.concurrent.ConcurrentHashMap$Segment[]

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HBASE-7092) RegionServer OOM related to onlineregions

Posted by "Jimmy Xiang (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HBASE-7092?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13490915#comment-13490915 ] 

Jimmy Xiang commented on HBASE-7092:
------------------------------------

Actually, it is not block cache.  It is memstore buffer.
                
> RegionServer OOM related to onlineregions
> -----------------------------------------
>
>                 Key: HBASE-7092
>                 URL: https://issues.apache.org/jira/browse/HBASE-7092
>             Project: HBase
>          Issue Type: Bug
>            Reporter: Jimmy Xiang
>            Assignee: Jimmy Xiang
>            Priority: Blocker
>             Fix For: 0.96.0
>
>         Attachments: heap-dump.png
>
>
> One instance of "java.util.concurrent.ConcurrentHashMap" loaded by "<system class loader>" occupies 3,972,154,848 (92.88%) bytes. The instance is referenced by org.apache.hadoop.hbase.regionserver.HRegionServer @ 0x7038d3798 , loaded by "sun.misc.Launcher$AppClassLoader @ 0x703994668". The memory is accumulated in one instance of "java.util.concurrent.ConcurrentHashMap$Segment[]" loaded by "<system class loader>".
> Keywords
> sun.misc.Launcher$AppClassLoader @ 0x703994668
> java.util.concurrent.ConcurrentHashMap
> java.util.concurrent.ConcurrentHashMap$Segment[]

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Updated] (HBASE-7092) RegionServer OOM with jdk 1.7 related to ConcurrentHashMap class loader

Posted by "Jimmy Xiang (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HBASE-7092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Jimmy Xiang updated HBASE-7092:
-------------------------------

    Issue Type: Bug  (was: Sub-task)
        Parent:     (was: HBASE-6182)
    
> RegionServer OOM with jdk 1.7 related to ConcurrentHashMap class loader
> -----------------------------------------------------------------------
>
>                 Key: HBASE-7092
>                 URL: https://issues.apache.org/jira/browse/HBASE-7092
>             Project: HBase
>          Issue Type: Bug
>            Reporter: Jimmy Xiang
>            Assignee: Jimmy Xiang
>             Fix For: 0.96.0
>
>         Attachments: heap-dump.png
>
>
> One instance of "java.util.concurrent.ConcurrentHashMap" loaded by "<system class loader>" occupies 3,972,154,848 (92.88%) bytes. The instance is referenced by org.apache.hadoop.hbase.regionserver.HRegionServer @ 0x7038d3798 , loaded by "sun.misc.Launcher$AppClassLoader @ 0x703994668". The memory is accumulated in one instance of "java.util.concurrent.ConcurrentHashMap$Segment[]" loaded by "<system class loader>".
> Keywords
> sun.misc.Launcher$AppClassLoader @ 0x703994668
> java.util.concurrent.ConcurrentHashMap
> java.util.concurrent.ConcurrentHashMap$Segment[]

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HBASE-7092) RegionServer OOM related to onlineregions

Posted by "stack (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HBASE-7092?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13491712#comment-13491712 ] 

stack commented on HBASE-7092:
------------------------------

How many regions per server?   4G or RAM?  I should add a note to important configs. in refguide Jimmy?  In 0.96 slab is on by default.
                
> RegionServer OOM related to onlineregions
> -----------------------------------------
>
>                 Key: HBASE-7092
>                 URL: https://issues.apache.org/jira/browse/HBASE-7092
>             Project: HBase
>          Issue Type: Bug
>            Reporter: Jimmy Xiang
>            Assignee: Jimmy Xiang
>            Priority: Blocker
>             Fix For: 0.96.0
>
>         Attachments: heap-dump.png
>
>
> One instance of "java.util.concurrent.ConcurrentHashMap" loaded by "<system class loader>" occupies 3,972,154,848 (92.88%) bytes. The instance is referenced by org.apache.hadoop.hbase.regionserver.HRegionServer @ 0x7038d3798 , loaded by "sun.misc.Launcher$AppClassLoader @ 0x703994668". The memory is accumulated in one instance of "java.util.concurrent.ConcurrentHashMap$Segment[]" loaded by "<system class loader>".
> Keywords
> sun.misc.Launcher$AppClassLoader @ 0x703994668
> java.util.concurrent.ConcurrentHashMap
> java.util.concurrent.ConcurrentHashMap$Segment[]

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HBASE-7092) RegionServer OOM with jdk 1.7 related to ConcurrentHashMap class loader

Posted by "Jimmy Xiang (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HBASE-7092?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13489866#comment-13489866 ] 

Jimmy Xiang commented on HBASE-7092:
------------------------------------

Started a 4 nodes cluster with JDK1.7. Ran ycsb for a short time and all regionserver died due to OOM.
                
> RegionServer OOM with jdk 1.7 related to ConcurrentHashMap class loader
> -----------------------------------------------------------------------
>
>                 Key: HBASE-7092
>                 URL: https://issues.apache.org/jira/browse/HBASE-7092
>             Project: HBase
>          Issue Type: Sub-task
>            Reporter: Jimmy Xiang
>            Assignee: Jimmy Xiang
>             Fix For: 0.96.0
>
>
> One instance of "java.util.concurrent.ConcurrentHashMap" loaded by "<system class loader>" occupies 3,972,154,848 (92.88%) bytes. The instance is referenced by org.apache.hadoop.hbase.regionserver.HRegionServer @ 0x7038d3798 , loaded by "sun.misc.Launcher$AppClassLoader @ 0x703994668". The memory is accumulated in one instance of "java.util.concurrent.ConcurrentHashMap$Segment[]" loaded by "<system class loader>".
> Keywords
> sun.misc.Launcher$AppClassLoader @ 0x703994668
> java.util.concurrent.ConcurrentHashMap
> java.util.concurrent.ConcurrentHashMap$Segment[]

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HBASE-7092) RegionServer OOM with jdk 1.7 related to ConcurrentHashMap class loader

Posted by "Jimmy Xiang (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HBASE-7092?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13490202#comment-13490202 ] 

Jimmy Xiang commented on HBASE-7092:
------------------------------------

I do have a heap dump which is more than 4GB.  I am using 1.7_9.  I will try 1.6 and see if I get the same issue so that I can find out it is really a jdk issue or a new code issue.
                
> RegionServer OOM with jdk 1.7 related to ConcurrentHashMap class loader
> -----------------------------------------------------------------------
>
>                 Key: HBASE-7092
>                 URL: https://issues.apache.org/jira/browse/HBASE-7092
>             Project: HBase
>          Issue Type: Sub-task
>            Reporter: Jimmy Xiang
>            Assignee: Jimmy Xiang
>             Fix For: 0.96.0
>
>
> One instance of "java.util.concurrent.ConcurrentHashMap" loaded by "<system class loader>" occupies 3,972,154,848 (92.88%) bytes. The instance is referenced by org.apache.hadoop.hbase.regionserver.HRegionServer @ 0x7038d3798 , loaded by "sun.misc.Launcher$AppClassLoader @ 0x703994668". The memory is accumulated in one instance of "java.util.concurrent.ConcurrentHashMap$Segment[]" loaded by "<system class loader>".
> Keywords
> sun.misc.Launcher$AppClassLoader @ 0x703994668
> java.util.concurrent.ConcurrentHashMap
> java.util.concurrent.ConcurrentHashMap$Segment[]

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Resolved] (HBASE-7092) RegionServer OOM related to onlineregions

Posted by "Jimmy Xiang (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HBASE-7092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Jimmy Xiang resolved HBASE-7092.
--------------------------------

    Resolution: Invalid

Found out the root cause: I have too many regions in each region server.  Each region allocates too much block cache.

So it is a configuration issue.  Closed as Invalid.
                
> RegionServer OOM related to onlineregions
> -----------------------------------------
>
>                 Key: HBASE-7092
>                 URL: https://issues.apache.org/jira/browse/HBASE-7092
>             Project: HBase
>          Issue Type: Bug
>            Reporter: Jimmy Xiang
>            Assignee: Jimmy Xiang
>            Priority: Blocker
>             Fix For: 0.96.0
>
>         Attachments: heap-dump.png
>
>
> One instance of "java.util.concurrent.ConcurrentHashMap" loaded by "<system class loader>" occupies 3,972,154,848 (92.88%) bytes. The instance is referenced by org.apache.hadoop.hbase.regionserver.HRegionServer @ 0x7038d3798 , loaded by "sun.misc.Launcher$AppClassLoader @ 0x703994668". The memory is accumulated in one instance of "java.util.concurrent.ConcurrentHashMap$Segment[]" loaded by "<system class loader>".
> Keywords
> sun.misc.Launcher$AppClassLoader @ 0x703994668
> java.util.concurrent.ConcurrentHashMap
> java.util.concurrent.ConcurrentHashMap$Segment[]

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Updated] (HBASE-7092) RegionServer OOM related to onlineregions

Posted by "Jimmy Xiang (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HBASE-7092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Jimmy Xiang updated HBASE-7092:
-------------------------------

    Summary: RegionServer OOM related to onlineregions  (was: RegionServer OOM with jdk 1.7 related to ConcurrentHashMap class loader)
    
> RegionServer OOM related to onlineregions
> -----------------------------------------
>
>                 Key: HBASE-7092
>                 URL: https://issues.apache.org/jira/browse/HBASE-7092
>             Project: HBase
>          Issue Type: Bug
>            Reporter: Jimmy Xiang
>            Assignee: Jimmy Xiang
>             Fix For: 0.96.0
>
>         Attachments: heap-dump.png
>
>
> One instance of "java.util.concurrent.ConcurrentHashMap" loaded by "<system class loader>" occupies 3,972,154,848 (92.88%) bytes. The instance is referenced by org.apache.hadoop.hbase.regionserver.HRegionServer @ 0x7038d3798 , loaded by "sun.misc.Launcher$AppClassLoader @ 0x703994668". The memory is accumulated in one instance of "java.util.concurrent.ConcurrentHashMap$Segment[]" loaded by "<system class loader>".
> Keywords
> sun.misc.Launcher$AppClassLoader @ 0x703994668
> java.util.concurrent.ConcurrentHashMap
> java.util.concurrent.ConcurrentHashMap$Segment[]

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HBASE-7092) RegionServer OOM related to onlineregions

Posted by "Jimmy Xiang (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HBASE-7092?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13491715#comment-13491715 ] 

Jimmy Xiang commented on HBASE-7092:
------------------------------------

I have about 2600 regions per server, and just 4G max heap. Slab is on by default in hbase-default.xml, not the code.
                
> RegionServer OOM related to onlineregions
> -----------------------------------------
>
>                 Key: HBASE-7092
>                 URL: https://issues.apache.org/jira/browse/HBASE-7092
>             Project: HBase
>          Issue Type: Bug
>            Reporter: Jimmy Xiang
>            Assignee: Jimmy Xiang
>            Priority: Blocker
>             Fix For: 0.96.0
>
>         Attachments: heap-dump.png
>
>
> One instance of "java.util.concurrent.ConcurrentHashMap" loaded by "<system class loader>" occupies 3,972,154,848 (92.88%) bytes. The instance is referenced by org.apache.hadoop.hbase.regionserver.HRegionServer @ 0x7038d3798 , loaded by "sun.misc.Launcher$AppClassLoader @ 0x703994668". The memory is accumulated in one instance of "java.util.concurrent.ConcurrentHashMap$Segment[]" loaded by "<system class loader>".
> Keywords
> sun.misc.Launcher$AppClassLoader @ 0x703994668
> java.util.concurrent.ConcurrentHashMap
> java.util.concurrent.ConcurrentHashMap$Segment[]

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Assigned] (HBASE-7092) RegionServer OOM with jdk 1.7 related to ConcurrentHashMap class loader

Posted by "Jimmy Xiang (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HBASE-7092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Jimmy Xiang reassigned HBASE-7092:
----------------------------------

    Assignee: Jimmy Xiang
    
> RegionServer OOM with jdk 1.7 related to ConcurrentHashMap class loader
> -----------------------------------------------------------------------
>
>                 Key: HBASE-7092
>                 URL: https://issues.apache.org/jira/browse/HBASE-7092
>             Project: HBase
>          Issue Type: Sub-task
>            Reporter: Jimmy Xiang
>            Assignee: Jimmy Xiang
>             Fix For: 0.96.0
>
>
> One instance of "java.util.concurrent.ConcurrentHashMap" loaded by "<system class loader>" occupies 3,972,154,848 (92.88%) bytes. The instance is referenced by org.apache.hadoop.hbase.regionserver.HRegionServer @ 0x7038d3798 , loaded by "sun.misc.Launcher$AppClassLoader @ 0x703994668". The memory is accumulated in one instance of "java.util.concurrent.ConcurrentHashMap$Segment[]" loaded by "<system class loader>".
> Keywords
> sun.misc.Launcher$AppClassLoader @ 0x703994668
> java.util.concurrent.ConcurrentHashMap
> java.util.concurrent.ConcurrentHashMap$Segment[]

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HBASE-7092) RegionServer OOM related to onlineregions

Posted by "stack (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HBASE-7092?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13491786#comment-13491786 ] 

stack commented on HBASE-7092:
------------------------------

I added a note to the MSLAB section that lots of regions could cause you OOME (MSLAB is on since 0.92, not 0.96 as I said above)
                
> RegionServer OOM related to onlineregions
> -----------------------------------------
>
>                 Key: HBASE-7092
>                 URL: https://issues.apache.org/jira/browse/HBASE-7092
>             Project: HBase
>          Issue Type: Bug
>            Reporter: Jimmy Xiang
>            Assignee: Jimmy Xiang
>            Priority: Blocker
>             Fix For: 0.96.0
>
>         Attachments: heap-dump.png
>
>
> One instance of "java.util.concurrent.ConcurrentHashMap" loaded by "<system class loader>" occupies 3,972,154,848 (92.88%) bytes. The instance is referenced by org.apache.hadoop.hbase.regionserver.HRegionServer @ 0x7038d3798 , loaded by "sun.misc.Launcher$AppClassLoader @ 0x703994668". The memory is accumulated in one instance of "java.util.concurrent.ConcurrentHashMap$Segment[]" loaded by "<system class loader>".
> Keywords
> sun.misc.Launcher$AppClassLoader @ 0x703994668
> java.util.concurrent.ConcurrentHashMap
> java.util.concurrent.ConcurrentHashMap$Segment[]

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HBASE-7092) RegionServer OOM related to onlineregions

Posted by "Jimmy Xiang (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HBASE-7092?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13490810#comment-13490810 ] 

Jimmy Xiang commented on HBASE-7092:
------------------------------------

I got the same issue with jdk 1.6.  So it is not a jdk issue.  Uploaded the head-dump image shows it may related to onlineregions.
                
> RegionServer OOM related to onlineregions
> -----------------------------------------
>
>                 Key: HBASE-7092
>                 URL: https://issues.apache.org/jira/browse/HBASE-7092
>             Project: HBase
>          Issue Type: Bug
>            Reporter: Jimmy Xiang
>            Assignee: Jimmy Xiang
>             Fix For: 0.96.0
>
>         Attachments: heap-dump.png
>
>
> One instance of "java.util.concurrent.ConcurrentHashMap" loaded by "<system class loader>" occupies 3,972,154,848 (92.88%) bytes. The instance is referenced by org.apache.hadoop.hbase.regionserver.HRegionServer @ 0x7038d3798 , loaded by "sun.misc.Launcher$AppClassLoader @ 0x703994668". The memory is accumulated in one instance of "java.util.concurrent.ConcurrentHashMap$Segment[]" loaded by "<system class loader>".
> Keywords
> sun.misc.Launcher$AppClassLoader @ 0x703994668
> java.util.concurrent.ConcurrentHashMap
> java.util.concurrent.ConcurrentHashMap$Segment[]

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira