[jira] [Created] (YARN-5864) Capacity Scheduler preemption for fragmented cluster

["Wangda Tan (JIRA)" <ji...@apache.org>]

Wangda Tan created YARN-5864:
--------------------------------

             Summary: Capacity Scheduler preemption for fragmented cluster 
                 Key: YARN-5864
                 URL: https://issues.apache.org/jira/browse/YARN-5864
             Project: Hadoop YARN
          Issue Type: New Feature
            Reporter: Wangda Tan
            Assignee: Wangda Tan


YARN-4390 added preemption for reserved container. However, we found one case that large container cannot be allocated even if all queues are under their limit.

For example, we have:
{code}
Two queues, a and b, capacity 50:50 
Two nodes: n1 and n2, each of them have 50 resource 
Now queue-a uses 10 on n1 and 10 on n2
queue-b asks for one single container with resource=45. 
{code} 

The container could be reserved on any of the host, but no preemption will happen because all queues are under their limits. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-dev-help@hadoop.apache.org