You are viewing a plain text version of this content. The canonical link for it is here.
Posted to yarn-issues@hadoop.apache.org by "Rohith Sharma K S (JIRA)" <ji...@apache.org> on 2018/03/22 18:18:00 UTC

[jira] [Comment Edited] (YARN-7032) [ATSv2] NPE while starting hbase co-processor when HBase authorization is enabled.

    [ https://issues.apache.org/jira/browse/YARN-7032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16129976#comment-16129976 ] 

Rohith Sharma K S edited comment on YARN-7032 at 3/22/18 6:17 PM:
------------------------------------------------------------------

Full stack trace is 
{noformat}
2017-08-17 05:53:13,535 ERROR [RpcServer.FifoWFPBQ.priority.handler=18,queue=0,port=16020] coprocessor.CoprocessorHost: The coprocessor org.apache.hadoop.yarn.server.timelineservice.storage.flow.FlowRunCoprocessor threw java.lang.NullPointerException
java.lang.NullPointerException
        at org.apache.hadoop.hbase.Tag.fromList(Tag.java:187)
        at org.apache.hadoop.yarn.server.timelineservice.storage.flow.FlowRunCoprocessor.prePut(FlowRunCoprocessor.java:102)
        at org.apache.hadoop.hbase.regionserver.RegionCoprocessorHost$30.call(RegionCoprocessorHost.java:885)
        at org.apache.hadoop.hbase.regionserver.RegionCoprocessorHost$RegionOperation.call(RegionCoprocessorHost.java:1660)
        at org.apache.hadoop.hbase.regionserver.RegionCoprocessorHost.execOperation(RegionCoprocessorHost.java:1734)
        at org.apache.hadoop.hbase.regionserver.RegionCoprocessorHost.execOperation(RegionCoprocessorHost.java:1692)
        at org.apache.hadoop.hbase.regionserver.RegionCoprocessorHost.prePut(RegionCoprocessorHost.java:881)
        at org.apache.hadoop.hbase.regionserver.HRegion.doPreMutationHook(HRegion.java:3036)
        at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:3011)
        at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2957)
        at org.apache.hadoop.hbase.regionserver.RSRpcServices.doBatchOp(RSRpcServices.java:750)
        at org.apache.hadoop.hbase.regionserver.RSRpcServices.doNonAtomicRegionMutation(RSRpcServices.java:710)
        at org.apache.hadoop.hbase.regionserver.RSRpcServices.multi(RSRpcServices.java:2137)
        at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32393)
        at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2150)
        at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:112)
        at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:187)
        at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:167)
localhost,16020,1502949162490: The coprocessor org.apache.hadoop.yarn.server.timelineservice.storage.flow.FlowRunCoprocessor threw java.lang.NullPointerException
java.lang.NullPointerException
        at org.apache.hadoop.hbase.Tag.fromList(Tag.java:187)
        at org.apache.hadoop.yarn.server.timelineservice.storage.flow.FlowRunCoprocessor.prePut(FlowRunCoprocessor.java:102)
        at org.apache.hadoop.hbase.regionserver.RegionCoprocessorHost$30.call(RegionCoprocessorHost.java:885)
        at org.apache.hadoop.hbase.regionserver.RegionCoprocessorHost$RegionOperation.call(RegionCoprocessorHost.java:1660)
        at org.apache.hadoop.hbase.regionserver.RegionCoprocessorHost.execOperation(RegionCoprocessorHost.java:1734)
        at org.apache.hadoop.hbase.regionserver.RegionCoprocessorHost.execOperation(RegionCoprocessorHost.java:1692)
        at org.apache.hadoop.hbase.regionserver.RegionCoprocessorHost.prePut(RegionCoprocessorHost.java:881)
        at org.apache.hadoop.hbase.regionserver.HRegion.doPreMutationHook(HRegion.java:3036)
        at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:3011)        at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2957)
        at org.apache.hadoop.hbase.regionserver.RSRpcServices.doBatchOp(RSRpcServices.java:750)
        at org.apache.hadoop.hbase.regionserver.RSRpcServices.doNonAtomicRegionMutation(RSRpcServices.java:710)
        at org.apache.hadoop.hbase.regionserver.RSRpcServices.multi(RSRpcServices.java:2137)
        at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32393)
        at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2150)
        at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:112)
        at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:187)
        at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:167)
2017-08-17 05:53:13,536 FATAL [RpcServer.FifoWFPBQ.priority.handler=18,queue=0,port=16020] regionserver.HRegionServer: RegionServer abort: loaded coprocessors are: [org.apache.hadoop.hbase.security.access.AccessController, org.apache.hadoop.yarn.server.timelineservice.storage.flow.FlowRunCoprocessor, org.apache.hadoop.hbase.security.token.TokenProvider, org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint, org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint]
{noformat}


was (Author: rohithsharma):
Full stack trace is 
{noformat}
2017-08-17 05:53:13,535 ERROR [RpcServer.FifoWFPBQ.priority.handler=18,queue=0,port=16020] coprocessor.CoprocessorHost: The coprocessor org.apache.hadoop.yarn.server.timelineservice.storage.flow.FlowRunCoprocessor threw java.lang.NullPointerException
java.lang.NullPointerException
        at org.apache.hadoop.hbase.Tag.fromList(Tag.java:187)
        at org.apache.hadoop.yarn.server.timelineservice.storage.flow.FlowRunCoprocessor.prePut(FlowRunCoprocessor.java:102)
        at org.apache.hadoop.hbase.regionserver.RegionCoprocessorHost$30.call(RegionCoprocessorHost.java:885)
        at org.apache.hadoop.hbase.regionserver.RegionCoprocessorHost$RegionOperation.call(RegionCoprocessorHost.java:1660)
        at org.apache.hadoop.hbase.regionserver.RegionCoprocessorHost.execOperation(RegionCoprocessorHost.java:1734)
        at org.apache.hadoop.hbase.regionserver.RegionCoprocessorHost.execOperation(RegionCoprocessorHost.java:1692)
        at org.apache.hadoop.hbase.regionserver.RegionCoprocessorHost.prePut(RegionCoprocessorHost.java:881)
        at org.apache.hadoop.hbase.regionserver.HRegion.doPreMutationHook(HRegion.java:3036)
        at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:3011)
        at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2957)
        at org.apache.hadoop.hbase.regionserver.RSRpcServices.doBatchOp(RSRpcServices.java:750)
        at org.apache.hadoop.hbase.regionserver.RSRpcServices.doNonAtomicRegionMutation(RSRpcServices.java:710)
        at org.apache.hadoop.hbase.regionserver.RSRpcServices.multi(RSRpcServices.java:2137)
        at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32393)
        at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2150)
        at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:112)
        at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:187)
        at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:167)
498516-98899-01-000006.hwx.site,16020,1502949162490: The coprocessor org.apache.hadoop.yarn.server.timelineservice.storage.flow.FlowRunCoprocessor threw java.lang.NullPointerException
java.lang.NullPointerException
        at org.apache.hadoop.hbase.Tag.fromList(Tag.java:187)
        at org.apache.hadoop.yarn.server.timelineservice.storage.flow.FlowRunCoprocessor.prePut(FlowRunCoprocessor.java:102)
        at org.apache.hadoop.hbase.regionserver.RegionCoprocessorHost$30.call(RegionCoprocessorHost.java:885)
        at org.apache.hadoop.hbase.regionserver.RegionCoprocessorHost$RegionOperation.call(RegionCoprocessorHost.java:1660)
        at org.apache.hadoop.hbase.regionserver.RegionCoprocessorHost.execOperation(RegionCoprocessorHost.java:1734)
        at org.apache.hadoop.hbase.regionserver.RegionCoprocessorHost.execOperation(RegionCoprocessorHost.java:1692)
        at org.apache.hadoop.hbase.regionserver.RegionCoprocessorHost.prePut(RegionCoprocessorHost.java:881)
        at org.apache.hadoop.hbase.regionserver.HRegion.doPreMutationHook(HRegion.java:3036)
        at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:3011)        at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2957)
        at org.apache.hadoop.hbase.regionserver.RSRpcServices.doBatchOp(RSRpcServices.java:750)
        at org.apache.hadoop.hbase.regionserver.RSRpcServices.doNonAtomicRegionMutation(RSRpcServices.java:710)
        at org.apache.hadoop.hbase.regionserver.RSRpcServices.multi(RSRpcServices.java:2137)
        at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32393)
        at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2150)
        at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:112)
        at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:187)
        at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:167)
2017-08-17 05:53:13,536 FATAL [RpcServer.FifoWFPBQ.priority.handler=18,queue=0,port=16020] regionserver.HRegionServer: RegionServer abort: loaded coprocessors are: [org.apache.hadoop.hbase.security.access.AccessController, org.apache.hadoop.yarn.server.timelineservice.storage.flow.FlowRunCoprocessor, org.apache.hadoop.hbase.security.token.TokenProvider, org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint, org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint]
{noformat}

> [ATSv2] NPE while starting hbase co-processor when HBase authorization is enabled.
> ----------------------------------------------------------------------------------
>
>                 Key: YARN-7032
>                 URL: https://issues.apache.org/jira/browse/YARN-7032
>             Project: Hadoop YARN
>          Issue Type: Sub-task
>            Reporter: Rohith Sharma K S
>            Assignee: Rohith Sharma K S
>            Priority: Critical
>             Fix For: 3.1.0, 2.10.0, 3.0.1
>
>         Attachments: YARN-7032.01.patch
>
>
> It is seen randomly that hbase co-processor fails to start with NPE. But again starting RegionServer, able to succeed in starting RS. 
> {noformat}
> 2017-08-17 05:53:13,535 ERROR [RpcServer.FifoWFPBQ.priority.handler=18,queue=0,port=16020] coprocessor.CoprocessorHost: The coprocessor org.apache.hadoop.yarn.server.timelineservice.storage.flow.FlowRunCoprocessor threw java.lang.NullPointerException
> java.lang.NullPointerException
>         at org.apache.hadoop.hbase.Tag.fromList(Tag.java:187)
>         at org.apache.hadoop.yarn.server.timelineservice.storage.flow.FlowRunCoprocessor.prePut(FlowRunCoprocessor.java:102)
>         at org.apache.hadoop.hbase.regionserver.RegionCoprocessorHost$30.call(RegionCoprocessorHost.java:885)
> {noformat}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org