You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hadoop.apache.org by "Chang.Wu" <58...@qq.com> on 2017/11/27 05:31:35 UTC

Why hasContainerForNode return false directly when there is no request of ANY locality?

I am studying the FairScheduler source cod of yarn 2.7.3.By the code of class FSAppAttempt:

​
  public boolean hasContainerForNode(Priority prio, FSSchedulerNode node) {
​
    ResourceRequest anyRequest = getResourceRequest(prio, ResourceRequest.ANY);  
    ResourceRequest rackRequest = getResourceRequest(prio, node.getRackName()); 
    ResourceRequest nodeRequest = getResourceRequest(prio, node.getNodeName()); 
    
    return
        // There must be outstanding requests at the given priority:
        anyRequest != null && anyRequest.getNumContainers() > 0 &&
            // If locality relaxation is turned off at *-level, there must be a
            // non-zero request for the node's rack:
            (anyRequest.getRelaxLocality() ||
                (rackRequest != null && rackRequest.getNumContainers() > 0)) &&
            // If locality relaxation is turned off at rack-level, there must be a
            // non-zero request at the node:
            (rackRequest == null || rackRequest.getRelaxLocality() ||
                (nodeRequest != null && nodeRequest.getNumContainers() > 0)) &&
            // The requested container must be able to fit on the node:
            Resources.lessThanOrEqual(RESOURCE_CALCULATOR, null,
                anyRequest.getCapability(), node.getRMNode().getTotalCapability());
}
​
​
I really cannot understand why when there is no anyRequest , namely whose locality is off-swith , hasContainerForNode() will return false directly ,without considering whether there is NODE_LOCAL  or  RACK_LOCAL requests.And ,  AppSchedulingInfo.allocateNodeLocal() and AppSchedulingInfo.allocateRackLocal() will also decrease the number of containers for ResourceRequest.ANY, this is another place where I feel confused.

Really thanks for some prompt.