You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hadoop.apache.org by Todd <bi...@163.com> on 2016/04/15 09:39:36 UTC

About Yarn Capacity Scheduler and Fair Scheduler

Hi,

I am kind of new to Yarn scheduler , I have a requirement that, we have vip users and normal users, we want vip users to have available resources whenever they submit applications so that vip users don't have to wait normal users to release their resources

Do Capacity Scheduler and Fair Scheduler support this scenario?
Thanks in advance!

Re:About Yarn Capacity Scheduler and Fair Scheduler

Posted by Todd <bi...@163.com>.
Thank you very much for the guide, Marcin!
BTW,did you have such article on Fair Scheduler?







在 2016-04-15 18:42:31,"Marcin Tustin" <mt...@handybook.com> 写道:
This is what the capacity scheduler is for. 


See my article on working around a particular bug in the current version of the capacity scheduler https://medium.com/handy-tech/practical-capacity-scheduling-with-yarn-28548ae4fb88


Note the part on user limits. 

On Friday, April 15, 2016, Todd <bi...@163.com> wrote:

Hi,

I am kind of new to Yarn scheduler , I have a requirement that, we have vip users and normal users, we want vip users to have available resources whenever they submit applications so that vip users don't have to wait normal users to release their resources

Do Capacity Scheduler and Fair Scheduler support this scenario?
Thanks in advance!



Want to work at Handy? Check out our culture deck and open roles
Latest news at Handy
Handy just raised $50m led by Fidelity


Re:About Yarn Capacity Scheduler and Fair Scheduler

Posted by Todd <bi...@163.com>.
Thank you very much for the guide, Marcin!
BTW,did you have such article on Fair Scheduler?







在 2016-04-15 18:42:31,"Marcin Tustin" <mt...@handybook.com> 写道:
This is what the capacity scheduler is for. 


See my article on working around a particular bug in the current version of the capacity scheduler https://medium.com/handy-tech/practical-capacity-scheduling-with-yarn-28548ae4fb88


Note the part on user limits. 

On Friday, April 15, 2016, Todd <bi...@163.com> wrote:

Hi,

I am kind of new to Yarn scheduler , I have a requirement that, we have vip users and normal users, we want vip users to have available resources whenever they submit applications so that vip users don't have to wait normal users to release their resources

Do Capacity Scheduler and Fair Scheduler support this scenario?
Thanks in advance!



Want to work at Handy? Check out our culture deck and open roles
Latest news at Handy
Handy just raised $50m led by Fidelity


Re:About Yarn Capacity Scheduler and Fair Scheduler

Posted by Todd <bi...@163.com>.
Thank you very much for the guide, Marcin!
BTW,did you have such article on Fair Scheduler?







在 2016-04-15 18:42:31,"Marcin Tustin" <mt...@handybook.com> 写道:
This is what the capacity scheduler is for. 


See my article on working around a particular bug in the current version of the capacity scheduler https://medium.com/handy-tech/practical-capacity-scheduling-with-yarn-28548ae4fb88


Note the part on user limits. 

On Friday, April 15, 2016, Todd <bi...@163.com> wrote:

Hi,

I am kind of new to Yarn scheduler , I have a requirement that, we have vip users and normal users, we want vip users to have available resources whenever they submit applications so that vip users don't have to wait normal users to release their resources

Do Capacity Scheduler and Fair Scheduler support this scenario?
Thanks in advance!



Want to work at Handy? Check out our culture deck and open roles
Latest news at Handy
Handy just raised $50m led by Fidelity


Re:About Yarn Capacity Scheduler and Fair Scheduler

Posted by Todd <bi...@163.com>.
Thank you very much for the guide, Marcin!
BTW,did you have such article on Fair Scheduler?







在 2016-04-15 18:42:31,"Marcin Tustin" <mt...@handybook.com> 写道:
This is what the capacity scheduler is for. 


See my article on working around a particular bug in the current version of the capacity scheduler https://medium.com/handy-tech/practical-capacity-scheduling-with-yarn-28548ae4fb88


Note the part on user limits. 

On Friday, April 15, 2016, Todd <bi...@163.com> wrote:

Hi,

I am kind of new to Yarn scheduler , I have a requirement that, we have vip users and normal users, we want vip users to have available resources whenever they submit applications so that vip users don't have to wait normal users to release their resources

Do Capacity Scheduler and Fair Scheduler support this scenario?
Thanks in advance!



Want to work at Handy? Check out our culture deck and open roles
Latest news at Handy
Handy just raised $50m led by Fidelity


About Yarn Capacity Scheduler and Fair Scheduler

Posted by Marcin Tustin <mt...@handybook.com>.
This is what the capacity scheduler is for.

See my article on working around a particular bug in the current version of
the capacity scheduler
https://medium.com/handy-tech/practical-capacity-scheduling-with-yarn-28548ae4fb88

Note the part on user limits.

On Friday, April 15, 2016, Todd <bit1129@163.com
<javascript:_e(%7B%7D,'cvml','bit1129@163.com');>> wrote:

> Hi,
>
> I am kind of new to Yarn scheduler , I have a requirement that, we have
> vip users and normal users, we want vip users to have available resources
> whenever they submit applications so that vip users don't have to wait
> normal users to release their resources
>
> Do Capacity Scheduler and Fair Scheduler support this scenario?
> Thanks in advance!
>

-- 
Want to work at Handy? Check out our culture deck and open roles 
<http://www.handy.com/careers>
Latest news <http://www.handy.com/press> at Handy
Handy just raised $50m 
<http://venturebeat.com/2015/11/02/on-demand-home-service-handy-raises-50m-in-round-led-by-fidelity/> led 
by Fidelity


About Yarn Capacity Scheduler and Fair Scheduler

Posted by Marcin Tustin <mt...@handybook.com>.
This is what the capacity scheduler is for.

See my article on working around a particular bug in the current version of
the capacity scheduler
https://medium.com/handy-tech/practical-capacity-scheduling-with-yarn-28548ae4fb88

Note the part on user limits.

On Friday, April 15, 2016, Todd <bit1129@163.com
<javascript:_e(%7B%7D,'cvml','bit1129@163.com');>> wrote:

> Hi,
>
> I am kind of new to Yarn scheduler , I have a requirement that, we have
> vip users and normal users, we want vip users to have available resources
> whenever they submit applications so that vip users don't have to wait
> normal users to release their resources
>
> Do Capacity Scheduler and Fair Scheduler support this scenario?
> Thanks in advance!
>

-- 
Want to work at Handy? Check out our culture deck and open roles 
<http://www.handy.com/careers>
Latest news <http://www.handy.com/press> at Handy
Handy just raised $50m 
<http://venturebeat.com/2015/11/02/on-demand-home-service-handy-raises-50m-in-round-led-by-fidelity/> led 
by Fidelity


About Yarn Capacity Scheduler and Fair Scheduler

Posted by Marcin Tustin <mt...@handybook.com>.
This is what the capacity scheduler is for.

See my article on working around a particular bug in the current version of
the capacity scheduler
https://medium.com/handy-tech/practical-capacity-scheduling-with-yarn-28548ae4fb88

Note the part on user limits.

On Friday, April 15, 2016, Todd <bit1129@163.com
<javascript:_e(%7B%7D,'cvml','bit1129@163.com');>> wrote:

> Hi,
>
> I am kind of new to Yarn scheduler , I have a requirement that, we have
> vip users and normal users, we want vip users to have available resources
> whenever they submit applications so that vip users don't have to wait
> normal users to release their resources
>
> Do Capacity Scheduler and Fair Scheduler support this scenario?
> Thanks in advance!
>

-- 
Want to work at Handy? Check out our culture deck and open roles 
<http://www.handy.com/careers>
Latest news <http://www.handy.com/press> at Handy
Handy just raised $50m 
<http://venturebeat.com/2015/11/02/on-demand-home-service-handy-raises-50m-in-round-led-by-fidelity/> led 
by Fidelity


About Yarn Capacity Scheduler and Fair Scheduler

Posted by Marcin Tustin <mt...@handybook.com>.
This is what the capacity scheduler is for.

See my article on working around a particular bug in the current version of
the capacity scheduler
https://medium.com/handy-tech/practical-capacity-scheduling-with-yarn-28548ae4fb88

Note the part on user limits.

On Friday, April 15, 2016, Todd <bit1129@163.com
<javascript:_e(%7B%7D,'cvml','bit1129@163.com');>> wrote:

> Hi,
>
> I am kind of new to Yarn scheduler , I have a requirement that, we have
> vip users and normal users, we want vip users to have available resources
> whenever they submit applications so that vip users don't have to wait
> normal users to release their resources
>
> Do Capacity Scheduler and Fair Scheduler support this scenario?
> Thanks in advance!
>

-- 
Want to work at Handy? Check out our culture deck and open roles 
<http://www.handy.com/careers>
Latest news <http://www.handy.com/press> at Handy
Handy just raised $50m 
<http://venturebeat.com/2015/11/02/on-demand-home-service-handy-raises-50m-in-round-led-by-fidelity/> led 
by Fidelity