You are viewing a plain text version of this content. The canonical link for it is here.
Posted to yarn-issues@hadoop.apache.org by "Joep Rottinghuis (JIRA)" <ji...@apache.org> on 2013/09/18 00:03:53 UTC

[jira] [Commented] (YARN-1032) NPE in RackResolve

    [ https://issues.apache.org/jira/browse/YARN-1032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13770052#comment-13770052 ] 

Joep Rottinghuis commented on YARN-1032:
----------------------------------------

Marking as critical. W/o this fix and when there is a problem with the rack resolver script, the MRAppMaster will simply hang. NPE make it somewhat tricky to find out what the root cause is.
                
> NPE in RackResolve
> ------------------
>
>                 Key: YARN-1032
>                 URL: https://issues.apache.org/jira/browse/YARN-1032
>             Project: Hadoop YARN
>          Issue Type: Bug
>    Affects Versions: 2.0.5-alpha
>         Environment: linux
>            Reporter: Lohit Vijayarenu
>            Priority: Critical
>         Attachments: YARN-1032.1.patch, YARN-1032.2.patch
>
>
> We found a case where our rack resolve script was not returning rack due to problem with resolving host address. This exception was see in RackResolver.java as NPE, ultimately caught in RMContainerAllocator. 
> {noformat}
> 2013-08-01 07:11:37,708 ERROR [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: ERROR IN CONTACTING RM. 
> java.lang.NullPointerException
> 	at org.apache.hadoop.yarn.util.RackResolver.coreResolve(RackResolver.java:99)
> 	at org.apache.hadoop.yarn.util.RackResolver.resolve(RackResolver.java:92)
> 	at org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator$ScheduledRequests.assignMapsWithLocality(RMContainerAllocator.java:1039)
> 	at org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator$ScheduledRequests.assignContainers(RMContainerAllocator.java:925)
> 	at org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator$ScheduledRequests.assign(RMContainerAllocator.java:861)
> 	at org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator$ScheduledRequests.access$400(RMContainerAllocator.java:681)
> 	at org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator.heartbeat(RMContainerAllocator.java:219)
> 	at org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator$1.run(RMCommunicator.java:243)
> 	at java.lang.Thread.run(Thread.java:722)
> {noformat}

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira