You are viewing a plain text version of this content. The canonical link for it is here.

Posted to yarn-dev@hadoop.apache.org by Sandy Ryza <sa...@cloudera.com> on 2012/12/22 01:04:32 UTC

queue ACLs in YARN

I'm working on the MR2 fair scheduler, and had a question about queue ACLs
that I thought someone might be able to answer?

In MR1, as far as I can tell from (
http://hadoop.apache.org/docs/mapreduce/current/mapred_tutorial.html#Job+Authorization),
queue ACLs were configured in the same place as application ACLs.  In YARN,
I'm having trouble figuring out where either of them are configured.
 Currently ACLs for fair scheduler queues are configured in
fair-scheduler.xml.  Is this how it should be?  Should queue ACLs be
configured in a scheduler's specific configuration, or in some other
central place?

many thanks, and happy holidays!
-Sandy

Re: queue ACLs in YARN

Posted by Sandy Ryza <sa...@cloudera.com>.

Thanks Arun.  I think that makes the most sense too.

-Sandy

On Fri, Dec 21, 2012 at 4:38 PM, Arun C Murthy <ac...@hortonworks.com> wrote:

> Sandy,
>
>  I'd recommend keeping ACLs in fair-scheduler.xml.
>
>  The MR1 way is crazy to manage... essentially we should keep all
> scheduler-specific configs/features in their own configs.
>
> thanks,
> Arun
>
> On Dec 22, 2012, at 5:34 AM, Sandy Ryza wrote:
>
> > I'm working on the MR2 fair scheduler, and had a question about queue
> ACLs
> > that I thought someone might be able to answer?
> >
> > In MR1, as far as I can tell from (
> >
> http://hadoop.apache.org/docs/mapreduce/current/mapred_tutorial.html#Job+Authorization
> ),
> > queue ACLs were configured in the same place as application ACLs.  In
> YARN,
> > I'm having trouble figuring out where either of them are configured.
> > Currently ACLs for fair scheduler queues are configured in
> > fair-scheduler.xml.  Is this how it should be?  Should queue ACLs be
> > configured in a scheduler's specific configuration, or in some other
> > central place?
> >
> > many thanks, and happy holidays!
> > -Sandy
>
> --
> Arun C. Murthy
> Hortonworks Inc.
> http://hortonworks.com/
>
>
>

Re: queue ACLs in YARN

Posted by Arun C Murthy <ac...@hortonworks.com>.

Sandy, 

 I'd recommend keeping ACLs in fair-scheduler.xml.

 The MR1 way is crazy to manage... essentially we should keep all scheduler-specific configs/features in their own configs.

thanks,
Arun

On Dec 22, 2012, at 5:34 AM, Sandy Ryza wrote:

> I'm working on the MR2 fair scheduler, and had a question about queue ACLs
> that I thought someone might be able to answer?
> 
> In MR1, as far as I can tell from (
> http://hadoop.apache.org/docs/mapreduce/current/mapred_tutorial.html#Job+Authorization),
> queue ACLs were configured in the same place as application ACLs.  In YARN,
> I'm having trouble figuring out where either of them are configured.
> Currently ACLs for fair scheduler queues are configured in
> fair-scheduler.xml.  Is this how it should be?  Should queue ACLs be
> configured in a scheduler's specific configuration, or in some other
> central place?
> 
> many thanks, and happy holidays!
> -Sandy

--
Arun C. Murthy
Hortonworks Inc.
http://hortonworks.com/