You are viewing a plain text version of this content. The canonical link for it is here.

Posted to yarn-issues@hadoop.apache.org by "Yufei Gu (JIRA)" <ji...@apache.org> on 2018/08/09 19:40:00 UTC

[jira] [Commented] (YARN-8639) Sort queue and apps in fair schduler using a separate thread

    [ https://issues.apache.org/jira/browse/YARN-8639?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16575302#comment-16575302 ] 

Yufei Gu commented on YARN-8639:
--------------------------------

We need to quantify a little bit before we'd make any non-trivial change. How many sub-queues/applications will be considered as too many, and cause performance issue. The result won't only justify why we need the change but also provide the guideline to tuning the queue settings. 

> Sort queue and apps in fair schduler using a separate thread
> ------------------------------------------------------------
>
>                 Key: YARN-8639
>                 URL: https://issues.apache.org/jira/browse/YARN-8639
>             Project: Hadoop YARN
>          Issue Type: Improvement
>          Components: yarn
>            Reporter: wan kun
>            Priority: Minor
>
> If fair scheduler have many queue and each queue have many active applications .
> For each assignContainer function, we need to sort all the queue, and all the applications in each queue. For a large system,this may be cost too much time. So we can sort the queue and applications using a separate thread asynchronous.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org