You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hadoop.apache.org by Vikas Parashar <pa...@gmail.com> on 2015/02/02 07:48:23 UTC
set default queue for user
Hello folks,
Could any body please let us know how can i assign a particular queue to my
user. My scenario is
Scheduler -> Capacity scheduler
Having 3 queue:-> A, B and C
Users -> user1, user2 and user3
Now, what i am looking from above scenario.
- if user1 submit any job that should automatically go to queue A.
- if user2 submit any job that should automatically go to queue B
- if user3 submit any job that should automatically go to queue C.
So, can anybody put some light on it; how can i make a default queue for
any user1,2 and 3.
Note** I don't want to define queue name at the run time(explicitly).
Rg:-
Vicky
Re: set default queue for user
Posted by Vikas Parashar <pa...@gmail.com>.
Thanks Naga!
Let me try it out.
On Mon, Feb 2, 2015 at 1:06 PM, Naganarasimha G R (Naga) <
garlanaganarasimha@huawei.com> wrote:
> Hi Vikas,
> To a small scale user to queue mapping was supported as part of
> YARN-2411,
> Please refer the following configurations :
> <property>
> <name>yarn.scheduler.capacity.queue-mappings</name>
> <value></value>
> <description>
> A list of mappings that will be used to assign jobs to queues
> The syntax for this list is [u|g]:[name]:[queue_name][,next mapping]*
> Typically this list will be used to map users to queues,
> for example, u:%user:%user maps all users to queues with the same
> name
> as the user.
> </description>
> </property>
>
> <property>
> <name>yarn.scheduler.capacity.queue-mappings-override.enable</name>
> <value>false</value>
> <description>
> If a queue mapping is present, will it override the value specified
> by the user? This can be used by administrators to place jobs in
> queues
> that are different than the one specified by the user.
> The default is false.
> </description>
> </property>
>
> Regards,
> Naga
> ------------------------------
> *From:* Vikas Parashar [para.vikas@gmail.com]
> *Sent:* Monday, February 02, 2015 12:18
> *To:* user@hadoop.apache.org
> *Subject:* set default queue for user
>
> Hello folks,
>
> Could any body please let us know how can i assign a particular queue to
> my user. My scenario is
>
> Scheduler -> Capacity scheduler
> Having 3 queue:-> A, B and C
> Users -> user1, user2 and user3
>
> Now, what i am looking from above scenario.
>
>
> - if user1 submit any job that should automatically go to queue A.
> - if user2 submit any job that should automatically go to queue B
> - if user3 submit any job that should automatically go to queue C.
>
> So, can anybody put some light on it; how can i make a default queue for
> any user1,2 and 3.
>
> Note** I don't want to define queue name at the run time(explicitly).
>
>
> Rg:-
> Vicky
>
Re: set default queue for user
Posted by Vikas Parashar <pa...@gmail.com>.
Thanks Naga!
Let me try it out.
On Mon, Feb 2, 2015 at 1:06 PM, Naganarasimha G R (Naga) <
garlanaganarasimha@huawei.com> wrote:
> Hi Vikas,
> To a small scale user to queue mapping was supported as part of
> YARN-2411,
> Please refer the following configurations :
> <property>
> <name>yarn.scheduler.capacity.queue-mappings</name>
> <value></value>
> <description>
> A list of mappings that will be used to assign jobs to queues
> The syntax for this list is [u|g]:[name]:[queue_name][,next mapping]*
> Typically this list will be used to map users to queues,
> for example, u:%user:%user maps all users to queues with the same
> name
> as the user.
> </description>
> </property>
>
> <property>
> <name>yarn.scheduler.capacity.queue-mappings-override.enable</name>
> <value>false</value>
> <description>
> If a queue mapping is present, will it override the value specified
> by the user? This can be used by administrators to place jobs in
> queues
> that are different than the one specified by the user.
> The default is false.
> </description>
> </property>
>
> Regards,
> Naga
> ------------------------------
> *From:* Vikas Parashar [para.vikas@gmail.com]
> *Sent:* Monday, February 02, 2015 12:18
> *To:* user@hadoop.apache.org
> *Subject:* set default queue for user
>
> Hello folks,
>
> Could any body please let us know how can i assign a particular queue to
> my user. My scenario is
>
> Scheduler -> Capacity scheduler
> Having 3 queue:-> A, B and C
> Users -> user1, user2 and user3
>
> Now, what i am looking from above scenario.
>
>
> - if user1 submit any job that should automatically go to queue A.
> - if user2 submit any job that should automatically go to queue B
> - if user3 submit any job that should automatically go to queue C.
>
> So, can anybody put some light on it; how can i make a default queue for
> any user1,2 and 3.
>
> Note** I don't want to define queue name at the run time(explicitly).
>
>
> Rg:-
> Vicky
>
Re: set default queue for user
Posted by Vikas Parashar <pa...@gmail.com>.
Thanks Naga!
Let me try it out.
On Mon, Feb 2, 2015 at 1:06 PM, Naganarasimha G R (Naga) <
garlanaganarasimha@huawei.com> wrote:
> Hi Vikas,
> To a small scale user to queue mapping was supported as part of
> YARN-2411,
> Please refer the following configurations :
> <property>
> <name>yarn.scheduler.capacity.queue-mappings</name>
> <value></value>
> <description>
> A list of mappings that will be used to assign jobs to queues
> The syntax for this list is [u|g]:[name]:[queue_name][,next mapping]*
> Typically this list will be used to map users to queues,
> for example, u:%user:%user maps all users to queues with the same
> name
> as the user.
> </description>
> </property>
>
> <property>
> <name>yarn.scheduler.capacity.queue-mappings-override.enable</name>
> <value>false</value>
> <description>
> If a queue mapping is present, will it override the value specified
> by the user? This can be used by administrators to place jobs in
> queues
> that are different than the one specified by the user.
> The default is false.
> </description>
> </property>
>
> Regards,
> Naga
> ------------------------------
> *From:* Vikas Parashar [para.vikas@gmail.com]
> *Sent:* Monday, February 02, 2015 12:18
> *To:* user@hadoop.apache.org
> *Subject:* set default queue for user
>
> Hello folks,
>
> Could any body please let us know how can i assign a particular queue to
> my user. My scenario is
>
> Scheduler -> Capacity scheduler
> Having 3 queue:-> A, B and C
> Users -> user1, user2 and user3
>
> Now, what i am looking from above scenario.
>
>
> - if user1 submit any job that should automatically go to queue A.
> - if user2 submit any job that should automatically go to queue B
> - if user3 submit any job that should automatically go to queue C.
>
> So, can anybody put some light on it; how can i make a default queue for
> any user1,2 and 3.
>
> Note** I don't want to define queue name at the run time(explicitly).
>
>
> Rg:-
> Vicky
>
Re: set default queue for user
Posted by Vikas Parashar <pa...@gmail.com>.
Thanks Naga!
Let me try it out.
On Mon, Feb 2, 2015 at 1:06 PM, Naganarasimha G R (Naga) <
garlanaganarasimha@huawei.com> wrote:
> Hi Vikas,
> To a small scale user to queue mapping was supported as part of
> YARN-2411,
> Please refer the following configurations :
> <property>
> <name>yarn.scheduler.capacity.queue-mappings</name>
> <value></value>
> <description>
> A list of mappings that will be used to assign jobs to queues
> The syntax for this list is [u|g]:[name]:[queue_name][,next mapping]*
> Typically this list will be used to map users to queues,
> for example, u:%user:%user maps all users to queues with the same
> name
> as the user.
> </description>
> </property>
>
> <property>
> <name>yarn.scheduler.capacity.queue-mappings-override.enable</name>
> <value>false</value>
> <description>
> If a queue mapping is present, will it override the value specified
> by the user? This can be used by administrators to place jobs in
> queues
> that are different than the one specified by the user.
> The default is false.
> </description>
> </property>
>
> Regards,
> Naga
> ------------------------------
> *From:* Vikas Parashar [para.vikas@gmail.com]
> *Sent:* Monday, February 02, 2015 12:18
> *To:* user@hadoop.apache.org
> *Subject:* set default queue for user
>
> Hello folks,
>
> Could any body please let us know how can i assign a particular queue to
> my user. My scenario is
>
> Scheduler -> Capacity scheduler
> Having 3 queue:-> A, B and C
> Users -> user1, user2 and user3
>
> Now, what i am looking from above scenario.
>
>
> - if user1 submit any job that should automatically go to queue A.
> - if user2 submit any job that should automatically go to queue B
> - if user3 submit any job that should automatically go to queue C.
>
> So, can anybody put some light on it; how can i make a default queue for
> any user1,2 and 3.
>
> Note** I don't want to define queue name at the run time(explicitly).
>
>
> Rg:-
> Vicky
>
RE: set default queue for user
Posted by "Naganarasimha G R (Naga)" <ga...@huawei.com>.
Hi Vikas,
To a small scale user to queue mapping was supported as part of YARN-2411,
Please refer the following configurations :
<property>
<name>yarn.scheduler.capacity.queue-mappings</name>
<value></value>
<description>
A list of mappings that will be used to assign jobs to queues
The syntax for this list is [u|g]:[name]:[queue_name][,next mapping]*
Typically this list will be used to map users to queues,
for example, u:%user:%user maps all users to queues with the same name
as the user.
</description>
</property>
<property>
<name>yarn.scheduler.capacity.queue-mappings-override.enable</name>
<value>false</value>
<description>
If a queue mapping is present, will it override the value specified
by the user? This can be used by administrators to place jobs in queues
that are different than the one specified by the user.
The default is false.
</description>
</property>
Regards,
Naga
________________________________
From: Vikas Parashar [para.vikas@gmail.com]
Sent: Monday, February 02, 2015 12:18
To: user@hadoop.apache.org
Subject: set default queue for user
Hello folks,
Could any body please let us know how can i assign a particular queue to my user. My scenario is
Scheduler -> Capacity scheduler
Having 3 queue:-> A, B and C
Users -> user1, user2 and user3
Now, what i am looking from above scenario.
* if user1 submit any job that should automatically go to queue A.
* if user2 submit any job that should automatically go to queue B
* if user3 submit any job that should automatically go to queue C.
So, can anybody put some light on it; how can i make a default queue for any user1,2 and 3.
Note** I don't want to define queue name at the run time(explicitly).
Rg:-
Vicky
RE: set default queue for user
Posted by "Naganarasimha G R (Naga)" <ga...@huawei.com>.
Hi Vikas,
To a small scale user to queue mapping was supported as part of YARN-2411,
Please refer the following configurations :
<property>
<name>yarn.scheduler.capacity.queue-mappings</name>
<value></value>
<description>
A list of mappings that will be used to assign jobs to queues
The syntax for this list is [u|g]:[name]:[queue_name][,next mapping]*
Typically this list will be used to map users to queues,
for example, u:%user:%user maps all users to queues with the same name
as the user.
</description>
</property>
<property>
<name>yarn.scheduler.capacity.queue-mappings-override.enable</name>
<value>false</value>
<description>
If a queue mapping is present, will it override the value specified
by the user? This can be used by administrators to place jobs in queues
that are different than the one specified by the user.
The default is false.
</description>
</property>
Regards,
Naga
________________________________
From: Vikas Parashar [para.vikas@gmail.com]
Sent: Monday, February 02, 2015 12:18
To: user@hadoop.apache.org
Subject: set default queue for user
Hello folks,
Could any body please let us know how can i assign a particular queue to my user. My scenario is
Scheduler -> Capacity scheduler
Having 3 queue:-> A, B and C
Users -> user1, user2 and user3
Now, what i am looking from above scenario.
* if user1 submit any job that should automatically go to queue A.
* if user2 submit any job that should automatically go to queue B
* if user3 submit any job that should automatically go to queue C.
So, can anybody put some light on it; how can i make a default queue for any user1,2 and 3.
Note** I don't want to define queue name at the run time(explicitly).
Rg:-
Vicky
RE: set default queue for user
Posted by "Naganarasimha G R (Naga)" <ga...@huawei.com>.
Hi Vikas,
To a small scale user to queue mapping was supported as part of YARN-2411,
Please refer the following configurations :
<property>
<name>yarn.scheduler.capacity.queue-mappings</name>
<value></value>
<description>
A list of mappings that will be used to assign jobs to queues
The syntax for this list is [u|g]:[name]:[queue_name][,next mapping]*
Typically this list will be used to map users to queues,
for example, u:%user:%user maps all users to queues with the same name
as the user.
</description>
</property>
<property>
<name>yarn.scheduler.capacity.queue-mappings-override.enable</name>
<value>false</value>
<description>
If a queue mapping is present, will it override the value specified
by the user? This can be used by administrators to place jobs in queues
that are different than the one specified by the user.
The default is false.
</description>
</property>
Regards,
Naga
________________________________
From: Vikas Parashar [para.vikas@gmail.com]
Sent: Monday, February 02, 2015 12:18
To: user@hadoop.apache.org
Subject: set default queue for user
Hello folks,
Could any body please let us know how can i assign a particular queue to my user. My scenario is
Scheduler -> Capacity scheduler
Having 3 queue:-> A, B and C
Users -> user1, user2 and user3
Now, what i am looking from above scenario.
* if user1 submit any job that should automatically go to queue A.
* if user2 submit any job that should automatically go to queue B
* if user3 submit any job that should automatically go to queue C.
So, can anybody put some light on it; how can i make a default queue for any user1,2 and 3.
Note** I don't want to define queue name at the run time(explicitly).
Rg:-
Vicky
RE: set default queue for user
Posted by "Naganarasimha G R (Naga)" <ga...@huawei.com>.
Hi Vikas,
To a small scale user to queue mapping was supported as part of YARN-2411,
Please refer the following configurations :
<property>
<name>yarn.scheduler.capacity.queue-mappings</name>
<value></value>
<description>
A list of mappings that will be used to assign jobs to queues
The syntax for this list is [u|g]:[name]:[queue_name][,next mapping]*
Typically this list will be used to map users to queues,
for example, u:%user:%user maps all users to queues with the same name
as the user.
</description>
</property>
<property>
<name>yarn.scheduler.capacity.queue-mappings-override.enable</name>
<value>false</value>
<description>
If a queue mapping is present, will it override the value specified
by the user? This can be used by administrators to place jobs in queues
that are different than the one specified by the user.
The default is false.
</description>
</property>
Regards,
Naga
________________________________
From: Vikas Parashar [para.vikas@gmail.com]
Sent: Monday, February 02, 2015 12:18
To: user@hadoop.apache.org
Subject: set default queue for user
Hello folks,
Could any body please let us know how can i assign a particular queue to my user. My scenario is
Scheduler -> Capacity scheduler
Having 3 queue:-> A, B and C
Users -> user1, user2 and user3
Now, what i am looking from above scenario.
* if user1 submit any job that should automatically go to queue A.
* if user2 submit any job that should automatically go to queue B
* if user3 submit any job that should automatically go to queue C.
So, can anybody put some light on it; how can i make a default queue for any user1,2 and 3.
Note** I don't want to define queue name at the run time(explicitly).
Rg:-
Vicky