You are viewing a plain text version of this content. The canonical link for it is here.
Posted to yarn-issues@hadoop.apache.org by "Karthik Kambatla (JIRA)" <ji...@apache.org> on 2016/12/23 03:22:58 UTC
[jira] [Comment Edited] (YARN-6021) When your allocated minShare of
all queue`s added up exceed cluster capacity you can get some queue for 0
fairshare
[ https://issues.apache.org/jira/browse/YARN-6021?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15771743#comment-15771743 ]
Karthik Kambatla edited comment on YARN-6021 at 12/23/16 3:22 AM:
------------------------------------------------------------------
I am still unable to understand.
Are you able to share an allocations file you had encountered this problem with? And, call out the specific allocation/preemption that was contrary to the expectation?
was (Author: kasha):
I still am unable to understand.
Are you able to share an allocations file you had encountered this problem with? And, call out the specific allocation/preemption that was contrary to the expectation?
> When your allocated minShare of all queue`s added up exceed cluster capacity you can get some queue for 0 fairshare
> -------------------------------------------------------------------------------------------------------------------
>
> Key: YARN-6021
> URL: https://issues.apache.org/jira/browse/YARN-6021
> Project: Hadoop YARN
> Issue Type: Bug
> Components: fairscheduler
> Affects Versions: 2.4.0
> Reporter: Feng Yuan
> Assignee: Feng Yuan
> Priority: Critical
>
> In fair-scheduler.xml,If you config the minshare add up exceed parentQueue`s fairshare,for root`s childs,fairshare is cluster capacity.
> You will found your R value look like below when compute childs fairshares:
> 1.0
> 0.5
> 0.25
> 0.125
> 0.0625
> 0.03125
> 0.015625
> 0.0078125
> 0.00390625
> I find this is due to:
> double rMax = 1.0;
> while (resourceUsedWithWeightToResourceRatio(rMax, schedulables, type)
> < totalResource) {
> rMax *= 2.0;
> }
> because resourceUsedWithWeightToResourceRatio will add minShare together.
> As i think is really should we bring in minShare when compute fairshare?
> My advice is we just consider weight is enough,and minshare's guarantee
> will get fulfill when assginContainer!
> Hope suggestion!
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org