You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-user@hadoop.apache.org by ArunKumar <ar...@gmail.com> on 2012/01/30 07:27:24 UTC
Mumak with Capacity Scheduler : Submitting jobs to a particular
queue
Hi guys !
I have run mumak with FIFO. It works fine.
I am trying to run jobtrace in test/data with capacity scheduler.
I have done :
1> Build contrib/capacity-scheduler
2>Copied hadoop-*-capacity-jar from build/contrib/capacity_scheduler to lib/
3>set "mapred.jobtracker.taskScheduler" to
"org.apache.hadoop.mapred.CapacityTaskScheduler" and added two queues for
"mapred.queue.names" in mapred-site.xml .
4>In conf/capacity-scheduler
set the propoery value for 2 queues
mapred.capacity-scheduler.queue.myqueue1.capacity 20
mapred.capacity-scheduler.queue.myqueue2.capacity 80
When i run :
$bin/mumak.sh src/test/data/19-jobs.trace.json.gz
src/test/data/19-jobs.topology.json.gz
I get :
12/01/30 11:45:39 WARN mapred.SimulatorJobTracker: Queue given for job
job_200904211745_0002 is not valid:java.io.IOException: Queue "default" does
not exist
Exception in thread "main" java.io.IOException: Queue "default" does not
exist
at
org.apache.hadoop.mapred.JobTracker.checkQueueValidity(JobTracker.java:3171)
at
org.apache.hadoop.mapred.SimulatorJobTracker.submitJob(SimulatorJobTracker.java:202)
at org.apache.hadoop.mapred.JobTracker.submitJob(JobTracker.java:3042)
at
org.apache.hadoop.mapred.SimulatorJobClient.submitJob(SimulatorJobClient.java:352)
at
org.apache.hadoop.mapred.SimulatorJobClient.processJobSubmissionEvent(SimulatorJobClient.java:231)
at
org.apache.hadoop.mapred.SimulatorJobClient.accept(SimulatorJobClient.java:207)
at org.apache.hadoop.mapred.SimulatorEngine.run(SimulatorEngine.java:299)
at org.apache.hadoop.mapred.SimulatorEngine.run(SimulatorEngine.java:323)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:69)
at org.apache.hadoop.mapred.SimulatorEngine.main(SimulatorEngine.java:315)
In web GUI i see two queues but submitted jobs are none.
Q>Also, Is there any way to submit jobs to a particular queue in case of
Mumak ?
Can anyone guide me in this regard ?
Thanks,
Arun
--
View this message in context: http://lucene.472066.n3.nabble.com/Mumak-with-Capacity-Scheduler-Submitting-jobs-to-a-particular-queue-tp3699258p3699258.html
Sent from the Hadoop lucene-users mailing list archive at Nabble.com.