You are viewing a plain text version of this content. The canonical link for it is here.
Posted to yarn-issues@hadoop.apache.org by "tangshangwen (JIRA)" <ji...@apache.org> on 2018/07/05 10:40:00 UTC
[jira] [Commented] (YARN-8496) The capacity scheduler uses label to
cause vcore to be incorrect
[ https://issues.apache.org/jira/browse/YARN-8496?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16533497#comment-16533497 ]
tangshangwen commented on YARN-8496:
------------------------------------
I think it's important to check that the resources meet the minimum resource allocation
{code:java}
// ParentQueue.java
@Override
public synchronized CSAssignment assignContainers(Resource clusterResource,
FiCaSchedulerNode node, ResourceLimits resourceLimits) {
CSAssignment assignment =
new CSAssignment(Resources.createResource(0, 0), NodeType.NODE_LOCAL);
Set<String> nodeLabels = node.getLabels();
if (!Resources.fitsIn(minimumAllocation, node.getAvailableResource())) {
return assignment;
}
...
}
{code}
> The capacity scheduler uses label to cause vcore to be incorrect
> ----------------------------------------------------------------
>
> Key: YARN-8496
> URL: https://issues.apache.org/jira/browse/YARN-8496
> Project: Hadoop YARN
> Issue Type: Bug
> Components: resourcemanager
> Affects Versions: 2.7.6
> Reporter: tangshangwen
> Assignee: tangshangwen
> Priority: Major
> Attachments: image-2018-07-05-18-29-32-697.png, yarn-bug.png
>
>
> In my cluster, I used tag scheduling, and I found that it caused the vcore of the cluster to be incorrect
> !image-2018-07-05-18-29-32-697.png!
> capacity-scheduler.xml
>
> {code:java}
> <configuration>
> <property>
> <name>yarn.scheduler.capacity.root.queues</name>
> <value>support</value>
> </property>
> <property>
> <name>yarn.scheduler.capacity.root.support.capacity</name>
> <value>100</value>
> </property>
> <property>
> <name>yarn.scheduler.capacity.root.support.accessible-node-labels</name>
> <value>test1</value>
> </property>
> <property>
> <name>yarn.scheduler.capacity.root.support.accessible-node-labels.test1.capacity</name>
> <value>100</value>
> </property>
> <property>
> <name>yarn.scheduler.capacity.root.accessible-node-labels.test1.capacity</name>
> <value>100</value>
> </property>
> </configuration>
> {code}
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org