You are viewing a plain text version of this content. The canonical link for it is here.
Posted to yarn-issues@hadoop.apache.org by "Adam Antal (JIRA)" <ji...@apache.org> on 2019/03/04 13:10:00 UTC
[jira] [Commented] (YARN-9322) Store metrics for custom resource
types into FSQueueMetrics and query them in FairSchedulerQueueInfo
[ https://issues.apache.org/jira/browse/YARN-9322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16783354#comment-16783354 ]
Adam Antal commented on YARN-9322:
----------------------------------
Hi [~snemeth], YARN-8842 looks like a big improvement, so it is might not be suitable to backport it to 3.1, 3.2 branches, as hadoop versioning states that
{quote}Maintenance releases include bug fixes or low-risk supportability changes.
{quote}
It seems to me that this issue does not make much sense without that either.
> Store metrics for custom resource types into FSQueueMetrics and query them in FairSchedulerQueueInfo
> ----------------------------------------------------------------------------------------------------
>
> Key: YARN-9322
> URL: https://issues.apache.org/jira/browse/YARN-9322
> Project: Hadoop YARN
> Issue Type: Improvement
> Reporter: Szilard Nemeth
> Assignee: Szilard Nemeth
> Priority: Major
> Fix For: 3.3.0
>
> Attachments: Screen Shot 2019-02-21 at 12.06.46.png, YARN-9322.001.patch, YARN-9322.002.patch, YARN-9322.003.patch, YARN-9322.004.patch, YARN-9322.005.patch, YARN-9322.006.patch
>
>
> YARN-8842 implemented storing and exposing of metrics of custom resources.
> FSQueueMetrics should have a similar implementation.
> All metrics stored in this class should have their custom resource counterpart.
> In a consequence of metrics were not stored for custom resource type, FairSchedulerQueueInfo haven't contained those values therefore the UI v1 could not show them, obviously.
> See that gpu is missing from the value of "AM Max Resources" on the attached screenshot.
> Additionally, the callees of the following methods (in class FairSchedulerQueueInfo) should consider to query values for custom resource types too:
> getMaxAMShareMB
> getMaxAMShareVCores
> getAMResourceUsageMB
> getAMResourceUsageVCores
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org