You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-user@hadoop.apache.org by Andre Gauthier <ga...@cs.umass.edu> on 2008/05/02 16:22:36 UTC

using sge, or drmaa for HOD

Hi, I currently have multiple clusters running Sun grid engine (sge) as 
it's resource manager/scheduler. I was wondering if there are any plans 
to incorporate drmaa into HOD , therefore, theoretically allowing HOD to 
run many different types of schedulers.  Also I was thinking of 
modifying HOD to run on grid engine.  I haven't really begun to pour 
over all the code for HOD but, my question is this, can I just write a 
python module similar to that of torque.py under hod/schedulers/ for sge 
  or would this require significant modification in HOD and possibly 
hadoop?

--Andre

Re: using sge, or drmaa for HOD

Posted by Andre Gauthier <ga...@cs.umass.edu>.
Yeah they are very similar, the commands are the same , but some options 
are different.

Allen Wittenauer wrote:
> On 5/2/08 7:22 AM, "Andre Gauthier" <ga...@cs.umass.edu> wrote:
>> Also I was thinking of
>> modifying HOD to run on grid engine.  I haven't really begun to pour
>> over all the code for HOD but, my question is this, can I just write a
>> python module similar to that of torque.py under hod/schedulers/ for sge
>>   or would this require significant modification in HOD and possibly
>> hadoop?
> 
>     Given that both torque and SGE are based off of (IEEE standard) PBS, it
> might even run unmodified. 
> 

Re: using sge, or drmaa for HOD

Posted by Allen Wittenauer <aw...@yahoo-inc.com>.
On 5/2/08 7:22 AM, "Andre Gauthier" <ga...@cs.umass.edu> wrote:
> Also I was thinking of
> modifying HOD to run on grid engine.  I haven't really begun to pour
> over all the code for HOD but, my question is this, can I just write a
> python module similar to that of torque.py under hod/schedulers/ for sge
>   or would this require significant modification in HOD and possibly
> hadoop?

    Given that both torque and SGE are based off of (IEEE standard) PBS, it
might even run unmodified.