You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hbase.apache.org by "Ted Yu (JIRA)" <ji...@apache.org> on 2016/08/04 22:56:20 UTC
[jira] [Commented] (HBASE-16359) NullPointerException in
RSRpcServices.openRegion()
[ https://issues.apache.org/jira/browse/HBASE-16359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15408610#comment-15408610 ]
Ted Yu commented on HBASE-16359:
--------------------------------
From master log:
{code}
2016-08-04 09:19:52,609 WARN [AM.ZK.Worker-pool2-t728] master.AssignmentManager: Failed assignment of hbck_table_772674,,1470302211047.da859880bb51bc0fd25979798a96c444. to nat-s11-4- ioss-hbase-5-6.openstacklocal,16020,1470293679953, trying to assign elsewhere instead; try=1 of 10
java.io.IOException: java.io.IOException
at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2172)
at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:107)
at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:133)
at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:108)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.NullPointerException
at org.apache.hadoop.hbase.regionserver.RSRpcServices.openRegion(RSRpcServices.java:1530)
at org.apache.hadoop.hbase.protobuf.generated.AdminProtos$AdminService$2.callBlockingMethod(AdminProtos.java:22737)
at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2127)
... 4 more
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:106)
at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:95)
at org.apache.hadoop.hbase.protobuf.ProtobufUtil.getRemoteException(ProtobufUtil.java:333)
at org.apache.hadoop.hbase.master.ServerManager.sendRegionOpen(ServerManager.java:759)
at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:2151)
at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1597)
at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1575)
at org.apache.hadoop.hbase.master.handler.ClosedRegionHandler.process(ClosedRegionHandler.java:106)
at org.apache.hadoop.hbase.master.AssignmentManager.handleRegion(AssignmentManager.java:1037)
at org.apache.hadoop.hbase.master.AssignmentManager$6.run(AssignmentManager.java:1518)
at org.apache.hadoop.hbase.master.AssignmentManager$3.run(AssignmentManager.java:1302)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(java.io.IOException): java.io.IOException
at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2172)
at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:107)
at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:133)
at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:108)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.NullPointerException
at org.apache.hadoop.hbase.regionserver.RSRpcServices.openRegion(RSRpcServices.java:1530)
at org.apache.hadoop.hbase.protobuf.generated.AdminProtos$AdminService$2.callBlockingMethod(AdminProtos.java:22737)
{code}
> NullPointerException in RSRpcServices.openRegion()
> --------------------------------------------------
>
> Key: HBASE-16359
> URL: https://issues.apache.org/jira/browse/HBASE-16359
> Project: HBase
> Issue Type: Bug
> Affects Versions: 1.1.2
> Reporter: Ted Yu
>
> I was investigating why some region failed to move out of transition within timeout 120000ms and found the following in region server log:
> {code}
> 2016-08-04 09:19:52,616 INFO [B.priority.fifo.QRpcServer.handler=12,queue=0,port=16020] regionserver.RSRpcServices: Open hbck_table_772674,,1470302211047. da859880bb51bc0fd25979798a96c444.
> 2016-08-04 09:19:52,620 ERROR [B.priority.fifo.QRpcServer.handler=12,queue=0,port=16020] ipc.RpcServer: Unexpected throwable object
> java.lang.NullPointerException
> at org.apache.hadoop.hbase.regionserver.RSRpcServices.openRegion(RSRpcServices.java:1530)
> at org.apache.hadoop.hbase.protobuf.generated.AdminProtos$AdminService$2.callBlockingMethod(AdminProtos.java:22737)
> at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2127)
> at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:107)
> at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:133)
> {code}
> Here is related code - NPE was thrown from the last line:
> {code}
> htd = htds.get(region.getTable());
> if (htd == null) {
> htd = regionServer.tableDescriptors.get(region.getTable());
> htds.put(region.getTable(), htd);
> }
> ...
> if (region.isMetaRegion()) {
> regionServer.service.submit(new OpenMetaHandler(
> regionServer, regionServer, region, htd, masterSystemTime, coordination, ord));
> } else {
> regionServer.updateRegionFavoredNodesMapping(region.getEncodedName(),
> regionOpenInfo.getFavoredNodesList());
> if (htd.getPriority() >= HConstants.ADMIN_QOS || region.getTable().isSystemTable()) {
> {code}
> region.getTable() shouldn't be null since it is called via htds.get(region.getTable()) unconditionally.
> It seems htd was null.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)