You are viewing a plain text version of this content. The canonical link for it is here.
Posted to yarn-dev@hadoop.apache.org by "Jon Bringhurst (Jira)" <ji...@apache.org> on 2019/12/18 18:45:00 UTC
[jira] [Created] (YARN-10044) ResourceManager NPE - Error in
handling event type NODE_UPDATE to the Event Dispatcher
Jon Bringhurst created YARN-10044:
-------------------------------------
Summary: ResourceManager NPE - Error in handling event type NODE_UPDATE to the Event Dispatcher
Key: YARN-10044
URL: https://issues.apache.org/jira/browse/YARN-10044
Project: Hadoop YARN
Issue Type: Improvement
Affects Versions: 2.9.2
Reporter: Jon Bringhurst
{noformat}
2019-12-18 00:46:42,577 [INFO] [IPC Server handler 48 on 8030] resourcemanager.RMAuditLogger.logSuccess(RMAuditLogger.java:200) - USER=vapp5003 IP=10.186.103.102 OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=
application_1575937033226_0426 CONTAINERID=container_e18_1575937033226_0426_01_000389 RESOURCE=<memory:5120, vCores:12>
2019-12-18 00:46:42,577 [INFO] [IPC Server handler 48 on 8030] rmcontainer.RMContainerImpl.handle(RMContainerImpl.java:486) - container_e18_1575937033226_0426_01_000392 Container Transitioned from ACQUIRED to RELEASED
2019-12-18 00:46:42,578 [INFO] [IPC Server handler 48 on 8030] resourcemanager.RMAuditLogger.logSuccess(RMAuditLogger.java:200) - USER=vapp5003 IP=10.186.103.102 OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=
application_1575937033226_0426 CONTAINERID=container_e18_1575937033226_0426_01_000392 RESOURCE=<memory:5120, vCores:12>
2019-12-18 00:46:42,578 [INFO] [SchedulerEventDispatcher:Event Processor] allocator.AbstractContainerAllocator.getCSAssignmentFromAllocateResult(AbstractContainerAllocator.java:126) - assignedContainer application attempt=appattempt_1575937033226
_0426_000001 container=null queue=org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator@73179037 clusterResource=<memory:151592720, vCores:115668> type=OFF_SWITCH requestedPartition=concourse
2019-12-18 00:46:42,578 [INFO] [IPC Server handler 48 on 8030] rmcontainer.RMContainerImpl.handle(RMContainerImpl.java:486) - container_e18_1575937033226_0426_01_000393 Container Transitioned from ACQUIRED to RELEASED
2019-12-18 00:46:42,578 [INFO] [SchedulerEventDispatcher:Event Processor] capacity.ParentQueue.assignContainers(ParentQueue.java:616) - assignedContainer queue=root usedCapacity=0.68548673 absoluteUsedCapacity=0.68548673 used=<memory:23682935, vC
ores:11062> cluster=<memory:151592720, vCores:115668>
2019-12-18 00:46:42,578 [INFO] [IPC Server handler 48 on 8030] resourcemanager.RMAuditLogger.logSuccess(RMAuditLogger.java:200) - USER=vapp5003 IP=10.186.103.102 OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=
application_1575937033226_0426 CONTAINERID=container_e18_1575937033226_0426_01_000393 RESOURCE=<memory:5120, vCores:12>
2019-12-18 00:46:42,579 [INFO] [IPC Server handler 48 on 8030] rmcontainer.RMContainerImpl.handle(RMContainerImpl.java:486) - container_e18_1575937033226_0426_01_000394 Container Transitioned from ACQUIRED to RELEASED
2019-12-18 00:46:42,579 [INFO] [IPC Server handler 48 on 8030] resourcemanager.RMAuditLogger.logSuccess(RMAuditLogger.java:200) - USER=vapp5003 IP=10.186.103.102 OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=
application_1575937033226_0426 CONTAINERID=container_e18_1575937033226_0426_01_000394 RESOURCE=<memory:5120, vCores:12>
2019-12-18 00:46:42,579 [INFO] [IPC Server handler 48 on 8030] scheduler.AppSchedulingInfo.updatePendingResources(AppSchedulingInfo.java:250) - checking for deactivate of application :application_1575937033226_0426
2019-12-18 00:46:42,580 [FATAL] [SchedulerEventDispatcher:Event Processor] event.EventDispatcher$EventProcessor.run(EventDispatcher.java:75) - Error in handling event type NODE_UPDATE to the Event Dispatcher
java.lang.NullPointerException
at org.apache.hadoop.yarn.server.resourcemanager.scheduler.AppSchedulingInfo.allocate(AppSchedulingInfo.java:448)
at org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.fica.FiCaSchedulerApp.apply(FiCaSchedulerApp.java:533)
at org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.tryCommit(CapacityScheduler.java:2563)
at org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.submitResourceCommitRequest(CapacityScheduler.java:2429)
at org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.allocateOrReserveNewContainers(CapacityScheduler.java:1359)
at org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.allocateContainerOnSingleNode(CapacityScheduler.java:1348)
at org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.allocateContainersToNode(CapacityScheduler.java:1437)
at org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.allocateContainersToNode(CapacityScheduler.java:1208)
at org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.nodeUpdate(CapacityScheduler.java:1070)
at org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.handle(CapacityScheduler.java:1479)
at org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.handle(CapacityScheduler.java:153)
at org.apache.hadoop.yarn.event.EventDispatcher$EventProcessor.run(EventDispatcher.java:66)
at java.lang.Thread.run(Thread.java:748)
2019-12-18 00:46:42,580 [INFO] [SchedulerEventDispatcher:Event Processor] event.EventDispatcher$EventProcessor.run(EventDispatcher.java:79) - Exiting, bbye..
2019-12-18 00:46:42,651 [ERROR] [Thread[Thread-20,5,main]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover.run(AbstractDelegationTokenSecretManager.java:696) - ExpiredTokenRemover received java.lang.InterruptedException: sleep
interrupted
2019-12-18 00:46:42,676 [INFO] [shutdown-hook-0] log.Slf4jLog.info(Slf4jLog.java:67) - Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@0.0.0.0:8088
2019-12-18 00:46:42,810 [INFO] [shutdown-hook-0] event.AsyncDispatcher.serviceStop(AsyncDispatcher.java:159) - AsyncDispatcher is draining to stop, ignoring any new events.
2019-12-18 00:46:42,812 [INFO] [shutdown-hook-0] event.AsyncDispatcher.serviceStop(AsyncDispatcher.java:159) - AsyncDispatcher is draining to stop, ignoring any new events.
2019-12-18 00:46:42,814 [INFO] [shutdown-hook-0] event.AsyncDispatcher.serviceStop(AsyncDispatcher.java:159) - AsyncDispatcher is draining to stop, ignoring any new events.
2019-12-18 00:46:42,816 [INFO] [shutdown-hook-0] event.AsyncDispatcher.serviceStop(AsyncDispatcher.java:159) - AsyncDispatcher is draining to stop, ignoring any new events.
2019-12-18 00:46:42,818 [INFO] [shutdown-hook-0] event.AsyncDispatcher.serviceStop(AsyncDispatcher.java:159) - AsyncDispatcher is draining to stop, ignoring any new events.
2019-12-18 00:46:42,918 [INFO] [shutdown-hook-0] event.AsyncDispatcher.serviceStop(AsyncDispatcher.java:169) - Waiting for AsyncDispatcher to drain. Thread state is :RUNNABLE
2019-12-18 00:46:43,009 [INFO] [Socket Reader #1 for port 8030] ipc.Server$Connection.saslProcess(Server.java:1820) - Auth successful for appattempt_1559780328064_0296_000004 (auth:SIMPLE)
2019-12-18 00:46:43,018 [INFO] [shutdown-hook-0] event.AsyncDispatcher.serviceStop(AsyncDispatcher.java:169) - Waiting for AsyncDispatcher to drain. Thread state is :RUNNABLE
2019-12-18 00:46:43,119 [INFO] [shutdown-hook-0] event.AsyncDispatcher.serviceStop(AsyncDispatcher.java:169) - Waiting for AsyncDispatcher to drain. Thread state is :RUNNABLE
2019-12-18 00:46:43,219 [INFO] [shutdown-hook-0] event.AsyncDispatcher.serviceStop(AsyncDispatcher.java:169) - Waiting for AsyncDispatcher to drain. Thread state is :RUNNABLE
{noformat}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-dev-help@hadoop.apache.org