You are viewing a plain text version of this content. The canonical link for it is here.
Posted to yarn-issues@hadoop.apache.org by "ASF GitHub Bot (Jira)" <ji...@apache.org> on 2025/01/08 10:52:00 UTC
[jira] [Updated] (YARN-11752) Global Scheduler : Improve the container allocation time
[ https://issues.apache.org/jira/browse/YARN-11752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
ASF GitHub Bot updated YARN-11752:
----------------------------------
Labels: pull-request-available (was: )
> Global Scheduler : Improve the container allocation time
> --------------------------------------------------------
>
> Key: YARN-11752
> URL: https://issues.apache.org/jira/browse/YARN-11752
> Project: Hadoop YARN
> Issue Type: Improvement
> Reporter: Syed Shameerur Rahman
> Assignee: Syed Shameerur Rahman
> Priority: Major
> Labels: pull-request-available
>
> As part of YARN-10380, The allocation strategy for multi-mode/global scheduler was changed from "node" list based to "partition" based, Due to this change, After every two container allocation, the scheduler waits for *5 milli seconds* by default as mentioned [here|[https://github.com/apache/hadoop/blob/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/CapacityScheduler.java#L627].]
> This significantly affects the container throughput. YARN SLS benchmark shows Async scheduling was *6x* better than Global scheduling in terms of container throughput for scheduling 1600 container with 50 nodes.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org