How to schedule a sqoop action using oozie

[shengjie min <ke...@gmail.com>]

Hi guys,

I am new to Oozie, just have a question here - How do I schedule a sqoop job using Oozie. I know sqoop action can be added as part of the Oozie workflow. But how can I schedule a sqoop action and get it running like every 2 mins or 8pm every day automatically (just lie a cron job)?

all the best,
Shengjie

RE: How to schedule a sqoop action using oozie

[Paul Chavez <pc...@verticalsearchworks.com>]

You will want to setup a Oozie coordinator job that has in interval set to your specifications and optionally input and/or output datasets. I use a coordinator to initiate a workflow every night that runs a sqoop from our SQL db and then a hive ETL script afterwards. It utilizes an output dataset to instantiate a path for the workflow used in both the sqoop and hive action.

Here is a good resource for developing coordinator jobs: https://github.com/yahoo/oozie/wiki/Oozie-Coord-Use-Cases

Hope that helps,
Paul Chavez

-----Original Message-----
From: shengjie min [mailto:kelvin.msj@gmail.com] 
Sent: Wednesday, August 07, 2013 10:12 PM
To: user@oozie.apache.org
Subject: How to schedule a sqoop action using oozie

Hi guys,

I am new to Oozie, just have a question here - How do I schedule a sqoop job using Oozie. I know sqoop action can be added as part of the Oozie workflow. But how can I schedule a sqoop action and get it running like every 2 mins or 8pm every day automatically (just lie a cron job)?

all the best,
Shengjie