You are viewing a plain text version of this content. The canonical link for it is here.
Posted to yarn-issues@hadoop.apache.org by "Eric Payne (JIRA)" <ji...@apache.org> on 2019/03/01 16:18:00 UTC
[jira] [Commented] (YARN-8625) Aggregate Resource Allocation for
each job is not present in ATS
[ https://issues.apache.org/jira/browse/YARN-8625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16781840#comment-16781840 ]
Eric Payne commented on YARN-8625:
----------------------------------
bq. Prabhu Joseph These metrics holds good for running applications. ATS doesn't have these data. Always ApplicationHistoryManagerOnTimelineStore constructs with empty resources.
[~Prabhu Joseph], I think [~rohithsharma] is correct. This only works as long as the RMApps are still in the RM's app list. For very busy clusters (like what we are running), the RM app list gets turned over within an hour or so (depending on the value of {{yarn.resourcemanager.max-completed-applications}}). There needs to be additional code to log this information in the AHS before it is lost from the RM app list.
> Aggregate Resource Allocation for each job is not present in ATS
> ----------------------------------------------------------------
>
> Key: YARN-8625
> URL: https://issues.apache.org/jira/browse/YARN-8625
> Project: Hadoop YARN
> Issue Type: Bug
> Components: ATSv2
> Affects Versions: 2.7.4
> Reporter: Prabhu Joseph
> Assignee: Prabhu Joseph
> Priority: Major
> Attachments: 0001-YARN-8625.patch, 0002-YARN-8625.patch
>
>
> Aggregate Resource Allocation shown on RM UI for finished job is very useful metric to understand how much resource a job has consumed. But this does not get stored in ATS.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org