You are viewing a plain text version of this content. The canonical link for it is here.
Posted to yarn-issues@hadoop.apache.org by "Eric Payne (Jira)" <ji...@apache.org> on 2021/03/01 23:02:00 UTC
[jira] [Commented] (YARN-10588) Percentage of queue and cluster is
zero in WebUI
[ https://issues.apache.org/jira/browse/YARN-10588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17293221#comment-17293221 ]
Eric Payne commented on YARN-10588:
-----------------------------------
[~BilwaST], sorry for the delay in replying.
bq. Changing {{DominantResourceCalculator#isInvalidDivisor}} to {{DominantResourceCalculator#isAllInvalidDivisor}} would solve problem. What do you think?
I verified that {{isAllInvalidDivisor}} is only true if all resources are 0. So, I agree that you could just replace with that.
[~Jim_Brennan], do you agree?
> Percentage of queue and cluster is zero in WebUI
> -------------------------------------------------
>
> Key: YARN-10588
> URL: https://issues.apache.org/jira/browse/YARN-10588
> Project: Hadoop YARN
> Issue Type: Bug
> Reporter: Bilwa S T
> Assignee: Bilwa S T
> Priority: Major
> Attachments: YARN-10588.001.patch, YARN-10588.002.patch, YARN-10588.003.patch
>
>
> Steps to reproduce:
> Configure below property in resource-types.xml
> {code:java}
> <property>
> <name>yarn.resource-types</name>
> <value>yarn.io/gpu</value>
> </property>{code}
> Submit a job
> In UI you can see % Of Queue and % Of Cluster is zero for the submitted application
>
> This is because in SchedulerApplicationAttempt has below check for calculating queueUsagePerc and clusterUsagePerc
> {code:java}
> if (!calc.isInvalidDivisor(cluster)) {
> float queueCapacityPerc = queue.getQueueInfo(false, false)
> .getCapacity();
> queueUsagePerc = calc.divide(cluster, usedResourceClone,
> Resources.multiply(cluster, queueCapacityPerc)) * 100;
> if (Float.isNaN(queueUsagePerc) || Float.isInfinite(queueUsagePerc)) {
> queueUsagePerc = 0.0f;
> }
> clusterUsagePerc =
> calc.divide(cluster, usedResourceClone, cluster) * 100;
> }
> {code}
> calc.isInvalidDivisor(cluster) always returns true as gpu resource is 0
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org