You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-user@hadoop.apache.org by Todd <bi...@163.com> on 2016/04/19 07:06:18 UTC
About yarn.scheduler.capacity..disable_preemption
Hi,
There is a configuration property yarn.scheduler.capacity.<queue-path>.disable_preemption that can be configured on a queue.
My question is when I set this property on root.A,does it mean that queue A's resources can't be preempted by other queues, or queue A can't
preempt resources from other queues?
Thanks!
Re: About yarn.scheduler.capacity..disable_preemption
Posted by Eric Payne <er...@yahoo.com.INVALID>.
Thanks Sunil.
Todd, also, please note that in order to enable the preemption feature, the feature's property must be set to true:yarn.resourcemanager.scheduler.monitor.enable: true
Then, if you want to turn preemption off for any particular queue, you would then set yarn.scheduler.capacity.<queue-path>.disable_preemption to false. At that point, apps on this particular queue will not be preempted. And, as Sunil said, this value is inherited by child queues.-Eric
From: Sunil Govind <su...@gmail.com>
To: Todd <bi...@163.com>; "user@hadoop.apache.org" <us...@hadoop.apache.org>
Sent: Tuesday, April 19, 2016 2:06 AM
Subject: Re: About yarn.scheduler.capacity.<queue-path>.disable_preemption
Hi Todd
If this configuration is enabled for a queue, proportional preemption policy will skip this queue from collecting resources for preemption.And this configuration is enabled for a parent queues, it's also applicable to its child queues as well.(will be inherited)
ThanksSunil
On Tue, Apr 19, 2016, 10:36 AM Todd <bi...@163.com> wrote:
Hi,
There is a configuration property yarn.scheduler.capacity.<queue-path>.disable_preemption that can be configured on a queue.
My question is when I set this property on root.A,does it mean that queue A's resources can't be preempted by other queues, or queue A can't
preempt resources from other queues?
Thanks!
Re: About yarn.scheduler.capacity..disable_preemption
Posted by Eric Payne <er...@yahoo.com.INVALID>.
Thanks Sunil.
Todd, also, please note that in order to enable the preemption feature, the feature's property must be set to true:yarn.resourcemanager.scheduler.monitor.enable: true
Then, if you want to turn preemption off for any particular queue, you would then set yarn.scheduler.capacity.<queue-path>.disable_preemption to false. At that point, apps on this particular queue will not be preempted. And, as Sunil said, this value is inherited by child queues.-Eric
From: Sunil Govind <su...@gmail.com>
To: Todd <bi...@163.com>; "user@hadoop.apache.org" <us...@hadoop.apache.org>
Sent: Tuesday, April 19, 2016 2:06 AM
Subject: Re: About yarn.scheduler.capacity.<queue-path>.disable_preemption
Hi Todd
If this configuration is enabled for a queue, proportional preemption policy will skip this queue from collecting resources for preemption.And this configuration is enabled for a parent queues, it's also applicable to its child queues as well.(will be inherited)
ThanksSunil
On Tue, Apr 19, 2016, 10:36 AM Todd <bi...@163.com> wrote:
Hi,
There is a configuration property yarn.scheduler.capacity.<queue-path>.disable_preemption that can be configured on a queue.
My question is when I set this property on root.A,does it mean that queue A's resources can't be preempted by other queues, or queue A can't
preempt resources from other queues?
Thanks!
Re: About yarn.scheduler.capacity..disable_preemption
Posted by Eric Payne <er...@yahoo.com.INVALID>.
Thanks Sunil.
Todd, also, please note that in order to enable the preemption feature, the feature's property must be set to true:yarn.resourcemanager.scheduler.monitor.enable: true
Then, if you want to turn preemption off for any particular queue, you would then set yarn.scheduler.capacity.<queue-path>.disable_preemption to false. At that point, apps on this particular queue will not be preempted. And, as Sunil said, this value is inherited by child queues.-Eric
From: Sunil Govind <su...@gmail.com>
To: Todd <bi...@163.com>; "user@hadoop.apache.org" <us...@hadoop.apache.org>
Sent: Tuesday, April 19, 2016 2:06 AM
Subject: Re: About yarn.scheduler.capacity.<queue-path>.disable_preemption
Hi Todd
If this configuration is enabled for a queue, proportional preemption policy will skip this queue from collecting resources for preemption.And this configuration is enabled for a parent queues, it's also applicable to its child queues as well.(will be inherited)
ThanksSunil
On Tue, Apr 19, 2016, 10:36 AM Todd <bi...@163.com> wrote:
Hi,
There is a configuration property yarn.scheduler.capacity.<queue-path>.disable_preemption that can be configured on a queue.
My question is when I set this property on root.A,does it mean that queue A's resources can't be preempted by other queues, or queue A can't
preempt resources from other queues?
Thanks!
Re: About yarn.scheduler.capacity..disable_preemption
Posted by Eric Payne <er...@yahoo.com.INVALID>.
Thanks Sunil.
Todd, also, please note that in order to enable the preemption feature, the feature's property must be set to true:yarn.resourcemanager.scheduler.monitor.enable: true
Then, if you want to turn preemption off for any particular queue, you would then set yarn.scheduler.capacity.<queue-path>.disable_preemption to false. At that point, apps on this particular queue will not be preempted. And, as Sunil said, this value is inherited by child queues.-Eric
From: Sunil Govind <su...@gmail.com>
To: Todd <bi...@163.com>; "user@hadoop.apache.org" <us...@hadoop.apache.org>
Sent: Tuesday, April 19, 2016 2:06 AM
Subject: Re: About yarn.scheduler.capacity.<queue-path>.disable_preemption
Hi Todd
If this configuration is enabled for a queue, proportional preemption policy will skip this queue from collecting resources for preemption.And this configuration is enabled for a parent queues, it's also applicable to its child queues as well.(will be inherited)
ThanksSunil
On Tue, Apr 19, 2016, 10:36 AM Todd <bi...@163.com> wrote:
Hi,
There is a configuration property yarn.scheduler.capacity.<queue-path>.disable_preemption that can be configured on a queue.
My question is when I set this property on root.A,does it mean that queue A's resources can't be preempted by other queues, or queue A can't
preempt resources from other queues?
Thanks!
Re: About yarn.scheduler.capacity..disable_preemption
Posted by Sunil Govind <su...@gmail.com>.
Hi Todd
If this configuration is enabled for a queue, proportional preemption
policy will skip this queue from collecting resources for preemption.
And this configuration is enabled for a parent queues, it's also applicable
to its child queues as well.(will be inherited)
Thanks
Sunil
On Tue, Apr 19, 2016, 10:36 AM Todd <bi...@163.com> wrote:
> Hi,
> There is a configuration property yarn.scheduler.capacity.<queue-path>.disable_preemption
> that can be configured on a queue.
> My question is when I set this property on root.A,does it mean that queue
> A's resources can't be preempted by other queues, or queue A can't
> preempt resources from other queues?
>
> Thanks!
>
>
>
Re: About yarn.scheduler.capacity..disable_preemption
Posted by Sunil Govind <su...@gmail.com>.
Hi Todd
If this configuration is enabled for a queue, proportional preemption
policy will skip this queue from collecting resources for preemption.
And this configuration is enabled for a parent queues, it's also applicable
to its child queues as well.(will be inherited)
Thanks
Sunil
On Tue, Apr 19, 2016, 10:36 AM Todd <bi...@163.com> wrote:
> Hi,
> There is a configuration property yarn.scheduler.capacity.<queue-path>.disable_preemption
> that can be configured on a queue.
> My question is when I set this property on root.A,does it mean that queue
> A's resources can't be preempted by other queues, or queue A can't
> preempt resources from other queues?
>
> Thanks!
>
>
>
Re: About yarn.scheduler.capacity..disable_preemption
Posted by Sunil Govind <su...@gmail.com>.
Hi Todd
If this configuration is enabled for a queue, proportional preemption
policy will skip this queue from collecting resources for preemption.
And this configuration is enabled for a parent queues, it's also applicable
to its child queues as well.(will be inherited)
Thanks
Sunil
On Tue, Apr 19, 2016, 10:36 AM Todd <bi...@163.com> wrote:
> Hi,
> There is a configuration property yarn.scheduler.capacity.<queue-path>.disable_preemption
> that can be configured on a queue.
> My question is when I set this property on root.A,does it mean that queue
> A's resources can't be preempted by other queues, or queue A can't
> preempt resources from other queues?
>
> Thanks!
>
>
>
Re: About yarn.scheduler.capacity..disable_preemption
Posted by Sunil Govind <su...@gmail.com>.
Hi Todd
If this configuration is enabled for a queue, proportional preemption
policy will skip this queue from collecting resources for preemption.
And this configuration is enabled for a parent queues, it's also applicable
to its child queues as well.(will be inherited)
Thanks
Sunil
On Tue, Apr 19, 2016, 10:36 AM Todd <bi...@163.com> wrote:
> Hi,
> There is a configuration property yarn.scheduler.capacity.<queue-path>.disable_preemption
> that can be configured on a queue.
> My question is when I set this property on root.A,does it mean that queue
> A's resources can't be preempted by other queues, or queue A can't
> preempt resources from other queues?
>
> Thanks!
>
>
>