[jira] [Created] (YARN-10589) Improve logic of multi-node allocation

["Tanu Ajmera (Jira)" <ji...@apache.org>]

Tanu Ajmera created YARN-10589:
----------------------------------

             Summary: Improve logic of multi-node allocation
                 Key: YARN-10589
                 URL: https://issues.apache.org/jira/browse/YARN-10589
             Project: Hadoop YARN
          Issue Type: Task
    Affects Versions: 3.3.0
            Reporter: Tanu Ajmera
            Assignee: Tanu Ajmera
             Fix For: 3.4.0


{code:java}
for (String partititon : partitions) {
 if (current++ > start) {
 break;
 }
 CandidateNodeSet<FiCaSchedulerNode> candidates =
 cs.getCandidateNodeSet(partititon);
 if (candidates == null) {
 continue;
 }
 cs.allocateContainersToNode(candidates, false);
}{code}
In above logic, if we have thousands of node in one partition, we will still repeatedly access all nodes of the partition thousands of times. There is no break point where if the partition is not same, it should stop checking other nodes in that partition.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org