You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-user@hadoop.apache.org by ArunKumar <ar...@gmail.com> on 2012/01/30 07:27:24 UTC

Mumak with Capacity Scheduler : Submitting jobs to a particular queue

Hi guys !

I have run mumak with FIFO. It works fine. 

I am trying to run jobtrace in test/data with capacity scheduler. 
I have done : 
1> Build contrib/capacity-scheduler 
2>Copied hadoop-*-capacity-jar from build/contrib/capacity_scheduler to lib/ 
3>set  "mapred.jobtracker.taskScheduler" to
"org.apache.hadoop.mapred.CapacityTaskScheduler" and added  two queues  for
"mapred.queue.names" in mapred-site.xml .
4>In conf/capacity-scheduler 
 set the propoery value for 2 queues 
  mapred.capacity-scheduler.queue.myqueue1.capacity 20 
  mapred.capacity-scheduler.queue.myqueue2.capacity  80 

When i run :
$bin/mumak.sh src/test/data/19-jobs.trace.json.gz
src/test/data/19-jobs.topology.json.gz

I get :
12/01/30 11:45:39 WARN mapred.SimulatorJobTracker: Queue given for job
job_200904211745_0002 is not valid:java.io.IOException: Queue "default" does
not exist
Exception in thread "main" java.io.IOException: Queue "default" does not
exist
	at
org.apache.hadoop.mapred.JobTracker.checkQueueValidity(JobTracker.java:3171)
	at
org.apache.hadoop.mapred.SimulatorJobTracker.submitJob(SimulatorJobTracker.java:202)
	at org.apache.hadoop.mapred.JobTracker.submitJob(JobTracker.java:3042)
	at
org.apache.hadoop.mapred.SimulatorJobClient.submitJob(SimulatorJobClient.java:352)
	at
org.apache.hadoop.mapred.SimulatorJobClient.processJobSubmissionEvent(SimulatorJobClient.java:231)
	at
org.apache.hadoop.mapred.SimulatorJobClient.accept(SimulatorJobClient.java:207)
	at org.apache.hadoop.mapred.SimulatorEngine.run(SimulatorEngine.java:299)
	at org.apache.hadoop.mapred.SimulatorEngine.run(SimulatorEngine.java:323)
	at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:69)
	at org.apache.hadoop.mapred.SimulatorEngine.main(SimulatorEngine.java:315)

In web GUI i see two queues but submitted jobs are none.

Q>Also, Is there any way to submit jobs to a particular queue in case of
Mumak ?

Can anyone guide me in this regard ?


Thanks,
Arun



--
View this message in context: http://lucene.472066.n3.nabble.com/Mumak-with-Capacity-Scheduler-Submitting-jobs-to-a-particular-queue-tp3699258p3699258.html
Sent from the Hadoop lucene-users mailing list archive at Nabble.com.