You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by "jack (Jira)" <ji...@apache.org> on 2019/09/04 07:21:00 UTC

[jira] [Commented] (AIRFLOW-569) Support for non contiguous schedules

    [ https://issues.apache.org/jira/browse/AIRFLOW-569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16922220#comment-16922220 ] 

jack commented on AIRFLOW-569:
------------------------------

[~milton0825] are you familiar with backfilling issues regarding specific crons?

> Support for non contiguous schedules
> ------------------------------------
>
>                 Key: AIRFLOW-569
>                 URL: https://issues.apache.org/jira/browse/AIRFLOW-569
>             Project: Apache Airflow
>          Issue Type: Bug
>          Components: scheduler
>    Affects Versions: 1.7.1.2
>            Reporter: Martin Grayson
>            Priority: Major
>
> I've recently created a dag that I want to run hourly, with the exception of a maintenance window during the night.
> To handle this, I use the cron syntax to specify the hours I wish to run.
> {code}schedule_interval='0 6,7,8,9,10,11,12,13,14,15,16,17,18,19,20,21,22 * * *'{code}
> i.e. Don't run 23:00-05:00
> This works well and actually executes as desired. The only issue is with backfilling. 
> When I initially deploy my dag, the scheduler creates the expected series of dag runs each hour since the start date, excluding the hours not in my schedule. However, when it comes to create the 06:00 execution, it simply fails the dag (and all subsequent) - I'm not sure why as I cant see any failure in the logs. The dag simply gets marked as failed.
> Is this a bug or something to be expected?
> Thanks,
> Martin



--
This message was sent by Atlassian Jira
(v8.3.2#803003)