You are viewing a plain text version of this content. The canonical link for it is here.
Posted to yarn-issues@hadoop.apache.org by "Qi Zhu (Jira)" <ji...@apache.org> on 2021/06/01 05:22:00 UTC
[jira] [Commented] (YARN-10795) Improve Capacity Scheduler
reinitialisation performance
[ https://issues.apache.org/jira/browse/YARN-10795?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17354809#comment-17354809 ]
Qi Zhu commented on YARN-10795:
-------------------------------
Thanks [~gandras] for this work.
It will be very helpful to clusters with many queues. :D
> Improve Capacity Scheduler reinitialisation performance
> -------------------------------------------------------
>
> Key: YARN-10795
> URL: https://issues.apache.org/jira/browse/YARN-10795
> Project: Hadoop YARN
> Issue Type: Improvement
> Components: capacity scheduler
> Reporter: Andras Gyori
> Priority: Major
>
> Mostly due to CapacitySchedulerConfiguration#getPropsWithPrefix or similar methods, the CapacityScheduler#reinit method has some quadratic complexity part with respect to queue numbers. Over 1000+ queues, it is a matter of minutes, which is too high to be a viable option when it is used in mutation api.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org