You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@yunikorn.apache.org by "Peter Bacsko (Jira)" <ji...@apache.org> on 2022/03/11 08:33:00 UTC
[jira] [Comment Edited] (YUNIKORN-790) Implement MaxApplications enforcement
[ https://issues.apache.org/jira/browse/YUNIKORN-790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17504788#comment-17504788 ]
Peter Bacsko edited comment on YUNIKORN-790 at 3/11/22, 8:32 AM:
-----------------------------------------------------------------
I need some clarification here. This feature is present in both Fair and Capacity Scheduler in Hadoop so I'd like to know how this feature compares to the existing one in those schedulers.
Eg in FS, one can set:
* {{root.users}} - maxRunningApps: 10
* {{root.users.alice}} - maxRunningApps: 20
* {{root.users.bob}} - maxRunningApps: 20
According to the JIRA specs, this configuration will not be allowed. Is this correct?
Next example:
* {{root.users}} - maxRunningApps: 10
* {{root.users.alice}} - maxRunningApps: 8
* {{root.users.bob}} - maxRunningApps: 8
{{root.users.alice}} has 7 applications running and {{root.users.bob}} has 3. Bob wants to submit another application to his queue, what is the expected behavior? Is {{root.users}} supposed to dominate the setting of ∑child(root.users) and force the application to stay in Pending state?
was (Author: pbacsko):
I need some clarification here. This feature is present in both Fair and Capacity Scheduler in Hadoop so I'd like to know how this one compares to the feature in those schedulers.
Eg in FS, one can set:
* {{root.users}} - maxRunningApps: 10
* {{root.users.alice}} - maxRunningApps: 20
* {{root.users.bob}} - maxRunningApps: 20
According to the JIRA specs, this configuration will not be allowed. Is this correct?
Next example:
* {{root.users}} - maxRunningApps: 10
* {{root.users.alice}} - maxRunningApps: 8
* {{root.users.bob}} - maxRunningApps: 8
{{root.users.alice}} has 7 applications running and {{root.users.bob}} has 3. Bob wants to submit another application to his queue, what is the expected behavior? Is {{root.users}} supposed to dominate the setting of ∑child(root.users) and force the application to stay in Pending state?
> Implement MaxApplications enforcement
> -------------------------------------
>
> Key: YUNIKORN-790
> URL: https://issues.apache.org/jira/browse/YUNIKORN-790
> Project: Apache YuniKorn
> Issue Type: New Feature
> Components: core - scheduler
> Reporter: Wilfred Spiegelenburg
> Assignee: Chung En Lee
> Priority: Major
> Labels: pull-request-available
>
> Queues have an option to set the MaxApplications that can run in a queue. There is currently no code in the scheduler that checks this setting.
> As a new feature we should add the enforcement for this setting:
> * enforce the setting on a leaf queue
> * enforce the setting on a parent, the apps running in a parent queue is defined as the sum of all the apps running in all leaf queues of the parent.
> As a side note from a config check: we need to make sure that the parent setting cannot be lower than any of the child queues it has. We _must not_ enforce that the parent setting must be larger than sum of all leafs.
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@yunikorn.apache.org
For additional commands, e-mail: issues-help@yunikorn.apache.org