You are viewing a plain text version of this content. The canonical link for it is here.
Posted to yarn-issues@hadoop.apache.org by "Suma Shivaprasad (JIRA)" <ji...@apache.org> on 2017/12/07 13:12:00 UTC
[jira] [Comment Edited] (YARN-7473) Implement Framework and policy
for capacity management of auto created queues
[ https://issues.apache.org/jira/browse/YARN-7473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16281824#comment-16281824 ]
Suma Shivaprasad edited comment on YARN-7473 at 12/7/17 1:11 PM:
-----------------------------------------------------------------
Thanks [~wangda] Attached patch with review comments addressed. Also made changes to AutoCreatedeafQueue.reinitializeFromTemplate to activateApplications after resetting capacity from template. This is needed when positive capacity is assigned to activate pending applications on leaf queue since user/application limit could have prevented apps from being activated earlier.
This patch also modified CSQueueUtils.updateUsedCapacity to use template configured capacity for AutoCreatedLeafQueue used capacity calculations
was (Author: suma.shivaprasad):
Thanks [~wangda] Attached patch with review comments addressed. Also made changes to AutoCreatedeafQueue.reinitializeFromTemplate to activateApplications after resetting capacity from template. This is needed when positive capacity is assigned to activate pending applications on leaf queue since user/application limit could have prevented apps from being activated earlier.
> Implement Framework and policy for capacity management of auto created queues
> ------------------------------------------------------------------------------
>
> Key: YARN-7473
> URL: https://issues.apache.org/jira/browse/YARN-7473
> Project: Hadoop YARN
> Issue Type: Sub-task
> Components: capacity scheduler
> Reporter: Suma Shivaprasad
> Assignee: Suma Shivaprasad
> Attachments: YARN-7473.1.patch, YARN-7473.10.patch, YARN-7473.11.patch, YARN-7473.12.patch, YARN-7473.12.patch, YARN-7473.13.patch, YARN-7473.14.patch, YARN-7473.15.patch, YARN-7473.2.patch, YARN-7473.3.patch, YARN-7473.4.patch, YARN-7473.5.patch, YARN-7473.6.patch, YARN-7473.7.patch, YARN-7473.8.patch, YARN-7473.9.patch
>
>
> This jira mainly addresses the following
>
> 1.Support adding pluggable policies on parent queue for dynamically managing capacity/state for leaf queues.
> 2. Implement a default policy that manages capacity based on pending applications and either grants guaranteed or zero capacity to queues based on parent's available guaranteed capacity.
> 3. Integrate with SchedulingEditPolicy framework to trigger this periodically and signal scheduler to take necessary actions for capacity/queue management.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org