You are viewing a plain text version of this content. The canonical link for it is here.
Posted to yarn-dev@hadoop.apache.org by "Sunil G (JIRA)" <ji...@apache.org> on 2017/04/28 18:15:04 UTC

[jira] [Created] (YARN-6538) Inter Queue preemption is not happening when DRF is configured

Sunil G created YARN-6538:
-----------------------------

             Summary: Inter Queue preemption is not happening when DRF is configured
                 Key: YARN-6538
                 URL: https://issues.apache.org/jira/browse/YARN-6538
             Project: Hadoop YARN
          Issue Type: Bug
          Components: scheduler preemption
    Affects Versions: 2.8.0
            Reporter: Sunil G
            Assignee: Sunil G


Cluster capacity of <memory:3TB, vCores:168>. Here memory is more and vcores are less. If applications have more demand, vcores might be exhausted. 
Inter queue preemption ideally has to be kicked in once vcores is over utilized. However preemption is not happening.

Analysis:
In {{AbstractPreemptableResourceCalculator.computeFixpointAllocation}}, 
{code}
    // assign all cluster resources until no more demand, or no resources are
    // left
    while (!orderedByNeed.isEmpty() && Resources.greaterThan(rc, totGuarant,
        unassigned, Resources.none())) {
{code}
 will loop even when vcores are 0. Hence we are having more vcores in idealAssigned which cause no-preemption cases.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-dev-help@hadoop.apache.org