You are viewing a plain text version of this content. The canonical link for it is here.
Posted to yarn-issues@hadoop.apache.org by "Eric Payne (Jira)" <ji...@apache.org> on 2021/03/01 23:02:00 UTC

[jira] [Commented] (YARN-10588) Percentage of queue and cluster is zero in WebUI

    [ https://issues.apache.org/jira/browse/YARN-10588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17293221#comment-17293221 ] 

Eric Payne commented on YARN-10588:
-----------------------------------

[~BilwaST], sorry for the delay in replying.

bq. Changing {{DominantResourceCalculator#isInvalidDivisor}} to {{DominantResourceCalculator#isAllInvalidDivisor}} would solve problem. What do you think?

I verified that {{isAllInvalidDivisor}} is only true if all resources are 0. So, I agree that you could just replace with that.

[~Jim_Brennan], do you agree?

> Percentage of queue and cluster is zero in WebUI 
> -------------------------------------------------
>
>                 Key: YARN-10588
>                 URL: https://issues.apache.org/jira/browse/YARN-10588
>             Project: Hadoop YARN
>          Issue Type: Bug
>            Reporter: Bilwa S T
>            Assignee: Bilwa S T
>            Priority: Major
>         Attachments: YARN-10588.001.patch, YARN-10588.002.patch, YARN-10588.003.patch
>
>
> Steps to reproduce:
> Configure below property in resource-types.xml
> {code:java}
> <property>
>  <name>yarn.resource-types</name>
>  <value>yarn.io/gpu</value>
>  </property>{code}
> Submit a job
> In UI you can see % Of Queue and % Of Cluster is zero for the submitted application
>  
> This is because in SchedulerApplicationAttempt has below check for calculating queueUsagePerc and clusterUsagePerc
> {code:java}
> if (!calc.isInvalidDivisor(cluster)) {
>         float queueCapacityPerc = queue.getQueueInfo(false, false)
>             .getCapacity();
>         queueUsagePerc = calc.divide(cluster, usedResourceClone,
>             Resources.multiply(cluster, queueCapacityPerc)) * 100;
>         if (Float.isNaN(queueUsagePerc) || Float.isInfinite(queueUsagePerc)) {
>           queueUsagePerc = 0.0f;
>         }
>         clusterUsagePerc =
>             calc.divide(cluster, usedResourceClone, cluster) * 100;
>       }
> {code}
> calc.isInvalidDivisor(cluster) always returns true as gpu resource is 0



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org