You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hbase.apache.org by "Jerry He (JIRA)" <ji...@apache.org> on 2016/02/26 06:37:18 UTC

[jira] [Commented] (HBASE-14798) NPE reporting server load causes regionserver abort; causes TestAcidGuarantee to fail

    [ https://issues.apache.org/jira/browse/HBASE-14798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15168472#comment-15168472 ] 

Jerry He commented on HBASE-14798:
----------------------------------

I saw this problem in a production cluster running HBase 1.1.1
{noformat}
2016-02-24 14:28:50,354 FATAL [regionserver/hadoop8.biginsights.com/10.200.50.144:60020] regionserver.HRegionServer: ABORTING region server hadoop8.biginsights.com,60020,1456280295877: Unhandled: null
java.lang.NullPointerException
	at org.apache.hadoop.hbase.regionserver.HRegion.getOldestHfileTs(HRegion.java:1613)
	at org.apache.hadoop.hbase.regionserver.HRegionServer.createRegionLoad(HRegionServer.java:1463)
	at org.apache.hadoop.hbase.regionserver.HRegionServer.buildServerLoad(HRegionServer.java:1187)
	at org.apache.hadoop.hbase.regionserver.HRegionServer.tryRegionServerReport(HRegionServer.java:1130)
	at org.apache.hadoop.hbase.regionserver.HRegionServer.run(HRegionServer.java:947)
	at java.lang.Thread.run(Thread.java:745)
2016-02-24 14:28:50,354 FATAL [regionserver/hadoop8.biginsights.com/10.200.50.144:60020] regionserver.HRegionServer: RegionServer abort: loaded coprocessors are: []
{noformat}

This important fix needs go to branch-1.1 as well.

> NPE reporting server load causes regionserver abort; causes TestAcidGuarantee to fail
> -------------------------------------------------------------------------------------
>
>                 Key: HBASE-14798
>                 URL: https://issues.apache.org/jira/browse/HBASE-14798
>             Project: HBase
>          Issue Type: Sub-task
>          Components: test
>            Reporter: stack
>            Assignee: stack
>             Fix For: 2.0.0, 1.2.0, 1.3.0
>
>         Attachments: 14798.patch, 14798.patch
>
>
> Below crashed out a RS. Caused TestAcidGuarantees to fail because then there were not RS to assign too... 
> {code}
> 2015-11-11 11:36:23,092 ERROR [B.defaultRpcServer.handler=4,queue=0,port=58655] master.MasterRpcServices(388): Region server asf907.gq1.ygridcore.net,55184,1447241756717 reported a fatal error:
> ABORTING region server asf907.gq1.ygridcore.net,55184,1447241756717: Unhandled: null
> Cause:
> java.lang.NullPointerException
> 	at org.apache.hadoop.hbase.regionserver.HRegion.getOldestHfileTs(HRegion.java:1643)
> 	at org.apache.hadoop.hbase.regionserver.HRegionServer.createRegionLoad(HRegionServer.java:1503)
> 	at org.apache.hadoop.hbase.regionserver.HRegionServer.buildServerLoad(HRegionServer.java:1210)
> 	at org.apache.hadoop.hbase.regionserver.HRegionServer.tryRegionServerReport(HRegionServer.java:1153)
> 	at org.apache.hadoop.hbase.regionserver.HRegionServer.run(HRegionServer.java:969)
> 	at org.apache.hadoop.hbase.MiniHBaseCluster$MiniHBaseClusterRegionServer.runRegionServer(MiniHBaseCluster.java:156)
> 	at org.apache.hadoop.hbase.MiniHBaseCluster$MiniHBaseClusterRegionServer.access$000(MiniHBaseCluster.java:108)
> 	at org.apache.hadoop.hbase.MiniHBaseCluster$MiniHBaseClusterRegionServer$1.run(MiniHBaseCluster.java:140)
> 	at java.security.AccessController.doPrivileged(Native Method)
> 	at javax.security.auth.Subject.doAs(Subject.java:360)
> 	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1637)
> 	at org.apache.hadoop.hbase.security.User$SecureHadoopUser.runAs(User.java:307)
> 	at org.apache.hadoop.hbase.MiniHBaseCluster$MiniHBaseClusterRegionServer.run(MiniHBaseCluster.java:138)
> 	at java.lang.Thread.run(Thread.java:745)
> {code}
> Here is the failure: https://builds.apache.org/view/H-L/view/HBase/job/HBase-Trunk_matrix/457/jdk=latest1.8,label=Hadoop/artifact/hbase-server/target/surefire-reports/org.apache.hadoop.hbase.TestAcidGuarantees-output.txt



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)