You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-user@hadoop.apache.org by Robert Grandl <rg...@student.ethz.ch> on 2011/02/05 14:51:13 UTC

Multiple queues question

Hi all,

I am trying to submit jobs to different queues in hadoop-0.20.2

I configured conf/mapred-site.xml
<property>
<name>mapred.queue.names</name>
<value>queue1, queue2</value>
</property>

Then I was starting wordcount job with following configuration:

<configuration>
<property>
<name>mapred.job.queue.name</name>
<value>queue1</value>
</property>
</configuration>

I am trying to run Hadoop with default FIFO scheduler.

However the wordcount job appears on 
http://localhost:50030/jobtracker.jsp that is was submitted
to both queue1 and queue2.

Did I forgot to configure something ?

Thank you very much,
Robert



Re: Multiple queues question

Posted by Sonal Goyal <so...@gmail.com>.
I think the CapacityScheduler is the one to use with multiple queues, see
http://hadoop.apache.org/common/docs/r0.19.2/capacity_scheduler.html
Thanks and Regards,
Sonal
<https://github.com/sonalgoyal/hiho>Connect Hadoop with databases,
Salesforce, FTP servers and others <https://github.com/sonalgoyal/hiho>
Nube Technologies <http://www.nubetech.co>

<http://in.linkedin.com/in/sonalgoyal>





On Sat, Feb 5, 2011 at 7:21 PM, Robert Grandl <rg...@student.ethz.ch>wrote:

> Hi all,
>
> I am trying to submit jobs to different queues in hadoop-0.20.2
>
> I configured conf/mapred-site.xml
> <property>
> <name>mapred.queue.names</name>
> <value>queue1, queue2</value>
> </property>
>
> Then I was starting wordcount job with following configuration:
>
> <configuration>
> <property>
> <name>mapred.job.queue.name</name>
> <value>queue1</value>
> </property>
> </configuration>
>
> I am trying to run Hadoop with default FIFO scheduler.
>
> However the wordcount job appears on http://localhost:50030/jobtracker.jspthat is was submitted
> to both queue1 and queue2.
>
> Did I forgot to configure something ?
>
> Thank you very much,
> Robert
>
>
>