You are viewing a plain text version of this content. The canonical link for it is here.
Posted to yarn-issues@hadoop.apache.org by "Haibo Chen (JIRA)" <ji...@apache.org> on 2018/10/04 21:54:00 UTC
[jira] [Commented] (YARN-8659) RMWebServices returns only RUNNING
apps when filtered with queue
[ https://issues.apache.org/jira/browse/YARN-8659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16638932#comment-16638932 ]
Haibo Chen commented on YARN-8659:
----------------------------------
Thanks [~snemeth] for the analysis. I agree with your observation.
When a queue is specified, the matching applications are retrieved currently from the scheduler, which knows only about the ones that are still actively involved in scheduling decision, a subset of all the applications that RM knows about. An application is removed from the scheduler's knowledge as soon as its scheduling part is done, but RM can still retain the application in its memory until it is evicted based on the max # of applications RM is allowed to remember.
IMO this is more of a bug than a API-compatibility-breaking change.
To reproduce the bug and verify the behavioral change, I think we need two uni test methods,
1) Two applications, one running and the other finished, query with state=finished and a queue, the result should contain the finished app (the result is empty now)
2) Two applications, one running and the other finished, query with queue specified but no state, the result should include both applications (the result is empty now)
> RMWebServices returns only RUNNING apps when filtered with queue
> ----------------------------------------------------------------
>
> Key: YARN-8659
> URL: https://issues.apache.org/jira/browse/YARN-8659
> Project: Hadoop YARN
> Issue Type: Bug
> Components: yarn
> Affects Versions: 2.7.3
> Reporter: Prabhu Joseph
> Assignee: Szilard Nemeth
> Priority: Major
> Attachments: Screen Shot 2018-08-13 at 8.01.29 PM.png, Screen Shot 2018-08-13 at 8.01.52 PM.png, YARN-8659.001.patch
>
>
> RMWebServices returns only RUNNING apps when filtered with queue and returns empty apps
> when filtered with both FINISHED states and queue.
> http://pjoseph-script-llap3.openstacklocal:8088/ws/v1/cluster/apps?queue=default
> http://pjoseph-script-llap3.openstacklocal:8088/ws/v1/cluster/apps?states=FINISHED&queue=default
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org