You are viewing a plain text version of this content. The canonical link for it is here.
Posted to yarn-issues@hadoop.apache.org by "Manikandan R (Jira)" <ji...@apache.org> on 2019/09/10 16:15:00 UTC

[jira] [Comment Edited] (YARN-9772) CapacitySchedulerQueueManager has incorrect list of queues

    [ https://issues.apache.org/jira/browse/YARN-9772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16926752#comment-16926752 ] 

Manikandan R edited comment on YARN-9772 at 9/10/19 4:14 PM:
-------------------------------------------------------------

To keep it simple and given the probability of having same names for parent and leaf queues is very less, Should we extend the duplicates check (as of now, it does only for leaf queues) to parent queues as well? 

[~sunilg] [~wangda] [~weiweiyagn666] [~eepayne] Please share your thoughts.


was (Author: manirajv06@gmail.com):
To keep it simple, Should we extend the duplicates check (as of now, it does only for leaf queues) to parent queues as well? 

[~sunilg] [~wangda] [~weiweiyagn666] [~eepayne] Please share your thoughts.

> CapacitySchedulerQueueManager has incorrect list of queues
> ----------------------------------------------------------
>
>                 Key: YARN-9772
>                 URL: https://issues.apache.org/jira/browse/YARN-9772
>             Project: Hadoop YARN
>          Issue Type: Bug
>            Reporter: Manikandan R
>            Assignee: Manikandan R
>            Priority: Major
>
> CapacitySchedulerQueueManager has incorrect list of queues when there is more than one parent queue (say at middle level) with same name.
> For example,
>  * root
>  ** a
>  *** b
>  **** c
>  *** d
>  **** b
>  ***** e
> {{CapacitySchedulerQueueManager#getQueues}} maintains these list of queues. While parsing "root.a.d.b", it overrides "root.a.b" with new Queue object in the map because of similar name. After parsing all the queues, map count should be 7, but it is 6. Any reference to queue "root.a.b" in code path is nothing but "root.a.d.b" object. Since {{CapacitySchedulerQueueManager#getQueues}} has been used in multiple places, will need to understand the implications in detail. For example, {{CapapcityScheduler#getQueue}} has been used in many places which in turn uses {{CapacitySchedulerQueueManager#getQueues}}. cc [~eepayne], [~sunilg]



--
This message was sent by Atlassian Jira
(v8.3.2#803003)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org