You are viewing a plain text version of this content. The canonical link for it is here.
Posted to yarn-dev@hadoop.apache.org by "Hu Ziqian (JIRA)" <ji...@apache.org> on 2018/09/04 15:05:04 UTC

[jira] [Created] (YARN-8743) capacity scheduler doesn't set node label to reserved container

Hu Ziqian created YARN-8743:
-------------------------------

             Summary: capacity scheduler doesn't set node label to reserved container
                 Key: YARN-8743
                 URL: https://issues.apache.org/jira/browse/YARN-8743
             Project: Hadoop YARN
          Issue Type: Bug
          Components: capacity scheduler, scheduler preemption
            Reporter: Hu Ziqian


capacity scheduler doesn't set node label when new a reserved container's RMContainerImpl and when allocate this container, leafQueue will treat it as a ignorePartitionExclusivityRMContainer.

This bug will cause preempt failure. When preempt happens, the preemption policy will try to preempt the reserved container while leafQueue doesn't remove it from ignorePartitionExclusivityRMContainers. In our cluster, we found that preemption policy will always try to preempt the reserved container and actually preempt nothing.

We set the node label information to  reserved container's RMContainerImpl and redo our test. The preemption performs as expected.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-dev-help@hadoop.apache.org