You are viewing a plain text version of this content. The canonical link for it is here.
Posted to yarn-issues@hadoop.apache.org by "Steve Loughran (JIRA)" <ji...@apache.org> on 2014/01/28 18:03:38 UTC

[jira] [Commented] (YARN-1663) NPE in FifoScheduler.assignContainers

    [ https://issues.apache.org/jira/browse/YARN-1663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13884329#comment-13884329 ] 

Steve Loughran commented on YARN-1663:
--------------------------------------

{code}
2014-01-28 16:56:00,665 [JUnit] INFO  client.HoyaClient (HoyaClient.java:executeClusterStart(905)) - Completed setting up app master command $JAVA_HOME/bin/java -Djava.net.preferIPv4Stack=true -Djava.awt.headless=true -Xmx256M -ea -esa -Dhoya.cluster.name=test_killed_am -Dhoya.app.type=hbase org.apache.hoya.yarn.appmaster.HoyaAppMaster create test_killed_am --debug --hoya-cluster-uri hdfs://localhost:54401/user/stevel/.hoya/cluster/test_killed_am --rm localhost:54393 --fs hdfs://localhost:54401/ 1><LOG_DIR>/hoyaam.txt 2><LOG_DIR>/hoyaam-err.txt 
2014-01-28 16:56:00,667 [JUnit] INFO  client.HoyaClient (HoyaClient.java:executeClusterStart(948)) - Submitting application to Resource Manager
2014-01-28 16:56:00,704 [IPC Server handler 3 on 54394] INFO  resourcemanager.ClientRMService (ClientRMService.java:submitApplication(326)) - Application with id 1 submitted by user stevel
2014-01-28 16:56:00,705 [AsyncDispatcher event handler] INFO  rmapp.RMAppImpl (RMAppImpl.java:transition(823)) - Storing application with id application_1390928154802_0001
2014-01-28 16:56:00,706 [IPC Server handler 3 on 54394] INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=stevel	IP=127.0.0.1	OPERATION=Submit Application Request	TARGET=ClientRMService	RESULT=SUCCESS	APPID=application_1390928154802_0001
2014-01-28 16:56:00,706 [AsyncDispatcher event handler] INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(631)) - application_1390928154802_0001 State change from NEW to NEW_SAVING
2014-01-28 16:56:00,711 [AsyncDispatcher event handler] INFO  recovery.RMStateStore (RMStateStore.java:handleStoreEvent(596)) - Storing info for app: application_1390928154802_0001
2014-01-28 16:56:00,720 [AsyncDispatcher event handler] INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(631)) - application_1390928154802_0001 State change from NEW_SAVING to SUBMITTED
2014-01-28 16:56:00,721 [ResourceManager Event Processor] INFO  fifo.FifoScheduler (FifoScheduler.java:addApplication(368)) - Accepted application application_1390928154802_0001 from user: stevel, currently num of applications: 1
2014-01-28 16:56:00,722 [ResourceManager Event Processor] FATAL resourcemanager.ResourceManager (ResourceManager.java:run(552)) - Error in handling event type NODE_UPDATE to the scheduler
java.lang.NullPointerException
	at org.apache.hadoop.yarn.server.resourcemanager.scheduler.fifo.FifoScheduler.assignContainers(FifoScheduler.java:461)
	at org.apache.hadoop.yarn.server.resourcemanager.scheduler.fifo.FifoScheduler.nodeUpdate(FifoScheduler.java:718)
	at org.apache.hadoop.yarn.server.resourcemanager.scheduler.fifo.FifoScheduler.handle(FifoScheduler.java:747)
	at org.apache.hadoop.yarn.server.resourcemanager.scheduler.fifo.FifoScheduler.handle(FifoScheduler.java:105)
	at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$SchedulerEventDispatcher$EventProcessor.run(ResourceManager.java:543)
	at java.lang.Thread.run(Thread.java:744)
2014-01-28 16:56:00,723 [ResourceManager Event Processor] INFO  resourcemanager.ResourceManager (ResourceManager.java:run(556)) - Exiting, bbye..
2014-01-28 16:56:00,724 [AsyncDispatcher event handler] INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(631)) - application_1390928154802_0001 State change from SUBMITTED to ACCEPTED
2014-01-28 16:56:00,724 [AsyncDispatcher event handler] INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerAppAttempt(568)) - Registering app attempt : appattempt_1390928154802_0001_000001

Results :

Tests run: 0, Failures: 0, Errors: 0, Skipped: 0

{code}

> NPE in FifoScheduler.assignContainers
> -------------------------------------
>
>                 Key: YARN-1663
>                 URL: https://issues.apache.org/jira/browse/YARN-1663
>             Project: Hadoop YARN
>          Issue Type: Bug
>          Components: scheduler
>    Affects Versions: 2.4.0
>         Environment: (starting AM client that is marked as wanting containers back on restart)
>            Reporter: Steve Loughran
>            Priority: Minor
>
> NPE see in scheduler thread running in a MiniYARNCluster with the fifo scheduler
> {code}
> 	at org.apache.hadoop.yarn.server.resourcemanager.scheduler.fifo.FifoScheduler.assignContainers(FifoScheduler.java:461)
> 	at org.apache.hadoop.yarn.server.resourcemanager.scheduler.fifo.FifoScheduler.nodeUpdate(FifoScheduler.java:718)
> 	at org.apache.hadoop.yarn.server.resourcemanager.scheduler.fifo.FifoScheduler.handle(FifoScheduler.java:747)
> 	at org.apache.hadoop.yarn.server.resourcemanager.scheduler.fifo.FifoScheduler.handle(FifoScheduler.java:105)
> 	at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$SchedulerEventDispatcher$EventProcessor.run(ResourceManager.java:543)
> {code}



--
This message was sent by Atlassian JIRA
(v6.1.5#6160)