You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by "Nick Benthem (Jira)" <ji...@apache.org> on 2020/01/16 01:52:00 UTC
[jira] [Created] (AIRFLOW-6577) DAG Backfill with timedelta runs
twice
Nick Benthem created AIRFLOW-6577:
-------------------------------------
Summary: DAG Backfill with timedelta runs twice
Key: AIRFLOW-6577
URL: https://issues.apache.org/jira/browse/AIRFLOW-6577
Project: Apache Airflow
Issue Type: Bug
Components: DAG, DagRun
Affects Versions: 1.10.7
Environment: ProductName: Mac OS X
ProductVersion: 10.14.6
BuildVersion: 18G2022
Client: Docker Engine - Community
Version: 19.03.5
API version: 1.40
Go version: go1.12.12
Git commit: 633a0ea
Built: Wed Nov 13 07:22:34 2019
OS/Arch: darwin/amd64
Experimental: false
Reporter: Nick Benthem
if you use {{timedelta=__anything__}}, and have {{catchup=False}}, it will cause a DOUBLE run of your DAG! The only workaround i found was to use a cron timer, i.e.,
schedule_interval='@daily',
Rather than
schedule_interval=timedelta(days=1),
It almost definitely exists in
def create_dag_run(self, dag, session=None):
in {{/Library/Frameworks/Python.framework/Versions/3.7/lib/python3.7/site-packages/airflow/jobs/scheduler_job.py }}
around line {{643}}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)