You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@oozie.apache.org by "Bowen Zhang (JIRA)" <ji...@apache.org> on 2014/06/10 22:17:03 UTC

[jira] [Resolved] (OOZIE-1431) Dataset frequencies should accept cron syntax

     [ https://issues.apache.org/jira/browse/OOZIE-1431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Bowen Zhang resolved OOZIE-1431.
--------------------------------

    Resolution: Won't Fix

Will create new issue if enough users ask for it.

> Dataset frequencies should accept cron syntax
> ---------------------------------------------
>
>                 Key: OOZIE-1431
>                 URL: https://issues.apache.org/jira/browse/OOZIE-1431
>             Project: Oozie
>          Issue Type: Sub-task
>            Reporter: Robert Kanter
>            Assignee: Bowen Zhang
>
> For example, instead of
> {code:xml}
> <datasets>
>         <dataset name="raw-logs" frequency="${coord:minutes(20)}" initial-instance="2010-01-01T00:00Z" timezone="UTC">
>             <uri-template>${nameNode}/user/${coord:user()}/${examplesRoot}/input-data/rawLogs/${YEAR}/${MONTH}/${DAY}/${HOUR}/${MINUTE}</uri-template>
>         </dataset>
>         <dataset name="aggregated-logs" frequency="${coord:hours(1)}" initial-instance="2010-01-01T01:00Z" timezone="UTC">
>             <uri-template>${nameNode}/user/${coord:user()}/${examplesRoot}/output-data/aggregator/aggregatedLogs/${YEAR}/${MONTH}/${DAY}/${HOUR}</uri-template>
>         </dataset>
>     </datasets>
> {code}
> we should be able to specify something like
> {code:xml}
> <datasets>
>         <dataset name="raw-logs" frequency="00 09-18 * * 1-5" initial-instance="2010-01-01T00:00Z" timezone="UTC">
>             <uri-template>${nameNode}/user/${coord:user()}/${examplesRoot}/input-data/rawLogs/${YEAR}/${MONTH}/${DAY}/${HOUR}/${MINUTE}</uri-template>
>         </dataset>
>         <dataset name="aggregated-logs" frequency="${coord:hours(1)}" initial-instance="2010-01-01T01:00Z" timezone="UTC">
>             <uri-template>${nameNode}/user/${coord:user()}/${examplesRoot}/output-data/aggregator/aggregatedLogs/${YEAR}/${MONTH}/${DAY}/${HOUR}</uri-template>
>         </dataset>
>     </datasets>
> {code}
> In the second version, the frequency is {{00 09-18 * * 1-5}} instead of {{$\{coord:minutes(20)}}}, which indicates that it will be 9am to 6pm mon-fri instead of every 20min.



--
This message was sent by Atlassian JIRA
(v6.2#6252)