You are viewing a plain text version of this content. The canonical link for it is here.
Posted to yarn-issues@hadoop.apache.org by "Eric Payne (Jira)" <ji...@apache.org> on 2021/09/07 17:51:00 UTC
[jira] [Created] (YARN-10935) AM Total Queue Limit goes below
per-uwer AM Limit if parent is full.
Eric Payne created YARN-10935:
---------------------------------
Summary: AM Total Queue Limit goes below per-uwer AM Limit if parent is full.
Key: YARN-10935
URL: https://issues.apache.org/jira/browse/YARN-10935
Project: Hadoop YARN
Issue Type: Improvement
Components: capacity scheduler, capacityscheduler
Reporter: Eric Payne
This happens when DRF is enabled and all of one resource is consumed but the second resources still has plenty available.
This is reproduceable by setting up a parent queue where the capacity and max capacity are the same, with 2 or more sub-queues whose max capacity is 100%.
In one of the sub-queues, start a long-running app that consumes all resources in the parent queue's hieararchy. This app will consume all of the memory but not vary many vcores (for example)
In a second queue, submit an app. The *{{Max Application Master Resources Per User}}* limit is much more than the *{{Max Application Master Resources}}* limit.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org