You are viewing a plain text version of this content. The canonical link for it is here.
Posted to yarn-issues@hadoop.apache.org by "Naganarasimha G R (JIRA)" <ji...@apache.org> on 2016/07/29 08:15:21 UTC

[jira] [Comment Edited] (YARN-5448) Resource in Cluster Metrics is not sum of resources in all nodes of all partitions

    [ https://issues.apache.org/jira/browse/YARN-5448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15398927#comment-15398927 ] 

Naganarasimha G R edited comment on YARN-5448 at 7/29/16 8:14 AM:
------------------------------------------------------------------

As per discussion with [~wangda], we had considered following options :
# *Metrics overview table* needs to show the resources of all the active NM's 
# *parititon-by-queue-hierarchy chart*, we can show non-usable partition (with some NM's) , and under the partition show "the partition is not assigned to any queue" Or other option is to show Partition resource in different font/color  (red) and having tool tip as "the partition is not assigned to any queue" 
Thoughts ?
CC [~sunilg],[~brahma], [~kanaka] & [~bibinchundatt]


was (Author: naganarasimha):
As per discussion with [~wangda], we had considered following options :
# *Metrics overview table* needs to show the resources of all the active NM's 
# *parititon-by-queue-hierarchy chart*, we can show non-usable partition (wi) , and under the partition show "the partition is not assigned to any queue" Or other option is to show Partition resource in different font/color  (red) and having tool tip as "the partition is not assigned to any queue" 
Thoughts ?
CC [~sunilg],[~brahma], [~kanaka] & [~bibinchundatt]

> Resource in Cluster Metrics is not sum of resources in all nodes of all partitions
> ----------------------------------------------------------------------------------
>
>                 Key: YARN-5448
>                 URL: https://issues.apache.org/jira/browse/YARN-5448
>             Project: Hadoop YARN
>          Issue Type: Bug
>          Components: capacity scheduler, resourcemanager, webapp
>    Affects Versions: 2.7.2
>            Reporter: Naganarasimha G R
>            Assignee: Naganarasimha G R
>         Attachments: NodesPage.png, schedulerPage.png
>
>
> Currently Resource info from Cluster Metrics are got from Queue Metrics's *available resource + allocated resource*. Hence if there are some nodes which belongs to partition but if that partition is not associated with any queue then in the capacity scheduler partition hierarchy shows this nodes resources under its partition but Cluster metrics doesn't show. 
> Apart from this in the Nodes page too Metrics overview table is shown. So if we show Resource info from Queue Metrics User will not be able to co relate it. (have attached the images for the same)
> IIUC idea of not showing in the *Metrics overview table* is to highlight that configuration is not proper. This needs to be some how conveyed through  parititon-by-queue-hierarchy chart.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org