You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@oozie.apache.org by Tim Chan <ti...@chan.net> on 2012/02/21 22:41:57 UTC

choosing a date range from dataset output

I would like to process a date range, let's say from 1/12 to current day.
So, everyday, I will be processing another day's worth of data.

The directory structure of which is of the pattern

2012/01/12/blah
2012/01/13/blah
...

Can I do this with a coordinator job?

Re: choosing a date range from dataset output

Posted by Mohammad Islam <mi...@yahoo.com>.

Hi Tim,
Coordinator should work for that use-case.

Look at the 'aggregator' in the example package.


More example could be found at :
https://github.com/yahoo/oozie/wiki/Oozie-Coord-Use-Cases
Regards,
Mohammad



----- Original Message -----
From: Tim Chan <ti...@chan.net>
To: oozie-users@incubator.apache.org
Cc: 
Sent: Tuesday, February 21, 2012 1:41 PM
Subject: choosing a date range from dataset output

I would like to process a date range, let's say from 1/12 to current day.
So, everyday, I will be processing another day's worth of data.

The directory structure of which is of the pattern

2012/01/12/blah
2012/01/13/blah
...

Can I do this with a coordinator job?