You are viewing a plain text version of this content. The canonical link for it is here.
Posted to yarn-dev@hadoop.apache.org by "Arun Suresh (JIRA)" <ji...@apache.org> on 2018/01/29 06:49:00 UTC

[jira] [Created] (YARN-7839) Check node capacity before placing in the Algorithm

Arun Suresh created YARN-7839:
---------------------------------

             Summary: Check node capacity before placing in the Algorithm
                 Key: YARN-7839
                 URL: https://issues.apache.org/jira/browse/YARN-7839
             Project: Hadoop YARN
          Issue Type: Sub-task
            Reporter: Arun Suresh


Currently, the Algorithm assigns a node to a requests purely based on if the constraints are met. It is later in the scheduling phase that the Queue capacity and Node capacity are checked. If the request cannot be placed because of unavailable Queue/Node capacity, the request is retried by the Algorithm.

For clusters that are running at high utilization, we can reduce the retries if we perform the Node capacity check in the Algorithm as well. The Queue capacity check can still be handled by the scheduler (since queues are tied to the scheduler)



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-dev-help@hadoop.apache.org