Executing oozie workflow actions on non-native clusters

[Som Satpathy <so...@gmail.com>]

Hi,

Does oozie support execution of a workflow action on a non-native cluster?

For example, I have oozie server running on my local machine, which is also
running hadoop. I want to run a workflow comprising of a map-reduce action
locally, but when I define the workflow.xml, I set the action's namenode
and jobtracker properties to a remote ec2 cluster. So, even if oozie spawns
a local map task for my action, the underlying map-reduce job itself gets
executed on the remote ec2 cluster. Can we do such a thing with oozie?

Thanks,
Som

Re: Executing oozie workflow actions on non-native clusters

[Som Satpathy <so...@gmail.com>]

Thanks for the info Harsh. I have been experimenting running oozie actions
on non-native clusters, have not succeeded yet. Hence wanted to know if
conceptually oozie supported such a case. I'll continue my experiments and
will get in touch if I face any problems.

Thanks,
Som


On Sat, Sep 7, 2013 at 2:32 AM, Harsh J <ha...@cloudera.com> wrote:

> Yes you can do such things with Oozie. It is built to not be tied to a
> single cluster, and can be freely configured to talk to other clusters
> (so long as their versions are compatible with the hadoop library
> Oozie uses to submit jobs).
>
> On Thu, Sep 5, 2013 at 5:13 AM, Som Satpathy <so...@gmail.com>
> wrote:
> > Hi,
> >
> > Does oozie support execution of a workflow action on a non-native
> cluster?
> >
> > For example, I have oozie server running on my local machine, which is
> also
> > running hadoop. I want to run a workflow comprising of a map-reduce
> action
> > locally, but when I define the workflow.xml, I set the action's namenode
> > and jobtracker properties to a remote ec2 cluster. So, even if oozie
> spawns
> > a local map task for my action, the underlying map-reduce job itself gets
> > executed on the remote ec2 cluster. Can we do such a thing with oozie?
> >
> > Thanks,
> > Som
>
>
>
> --
> Harsh J
>

Re: Executing oozie workflow actions on non-native clusters

[Harsh J <ha...@cloudera.com>]

Yes you can do such things with Oozie. It is built to not be tied to a
single cluster, and can be freely configured to talk to other clusters
(so long as their versions are compatible with the hadoop library
Oozie uses to submit jobs).

On Thu, Sep 5, 2013 at 5:13 AM, Som Satpathy <so...@gmail.com> wrote:
> Hi,
>
> Does oozie support execution of a workflow action on a non-native cluster?
>
> For example, I have oozie server running on my local machine, which is also
> running hadoop. I want to run a workflow comprising of a map-reduce action
> locally, but when I define the workflow.xml, I set the action's namenode
> and jobtracker properties to a remote ec2 cluster. So, even if oozie spawns
> a local map task for my action, the underlying map-reduce job itself gets
> executed on the remote ec2 cluster. Can we do such a thing with oozie?
>
> Thanks,
> Som



-- 
Harsh J