You are viewing a plain text version of this content. The canonical link for it is here.
Posted to yarn-issues@hadoop.apache.org by "Hadoop QA (Jira)" <ji...@apache.org> on 2019/09/03 08:26:00 UTC
[jira] [Commented] (YARN-8743) capacity scheduler doesn't set node
label to reserved container
[ https://issues.apache.org/jira/browse/YARN-8743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16921250#comment-16921250 ]
Hadoop QA commented on YARN-8743:
---------------------------------
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:blue}0{color} | {color:blue} reexec {color} | {color:blue} 0m 0s{color} | {color:blue} Docker mode activated. {color} |
| {color:red}-1{color} | {color:red} patch {color} | {color:red} 0m 7s{color} | {color:red} YARN-8743 does not apply to trunk. Rebase required? Wrong Branch? See https://wiki.apache.org/hadoop/HowToContribute for help. {color} |
\\
\\
|| Subsystem || Report/Notes ||
| JIRA Issue | YARN-8743 |
| JIRA Patch URL | https://issues.apache.org/jira/secure/attachment/12938417/YARN-8743.002.patch |
| Console output | https://builds.apache.org/job/PreCommit-YARN-Build/24717/console |
| Powered by | Apache Yetus 0.8.0 http://yetus.apache.org |
This message was automatically generated.
> capacity scheduler doesn't set node label to reserved container
> ---------------------------------------------------------------
>
> Key: YARN-8743
> URL: https://issues.apache.org/jira/browse/YARN-8743
> Project: Hadoop YARN
> Issue Type: Bug
> Components: capacity scheduler, scheduler preemption
> Reporter: Hu Ziqian
> Assignee: Hu Ziqian
> Priority: Major
> Attachments: YARN-8743.001.patch, YARN-8743.002.patch
>
>
> capacity scheduler doesn't set node label when new a reserved container's RMContainerImpl. When allocate this container, leafQueue will treat it as a ignorePartitionExclusivityRMContainer.
> It will cause preempt failure. When preempt happens, the preemption policy will try to preempt the reserved container while leafQueue doesn't remove it from ignorePartitionExclusivityRMContainers. In our cluster, we found that preemption policy will always try to preempt the reserved container and actually preempt nothing.
> We set the node label information to reserved container's RMContainerImpl and redo our test. The preemption performs as expected.
--
This message was sent by Atlassian Jira
(v8.3.2#803003)
---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org