You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@airflow.apache.org by "Dan Davydov (JIRA)" <ji...@apache.org> on 2017/04/26 19:23:04 UTC

[jira] [Created] (AIRFLOW-1152) Backfill dagruns should not hang DAGs

Dan Davydov created AIRFLOW-1152:
------------------------------------

             Summary: Backfill dagruns should not hang DAGs
                 Key: AIRFLOW-1152
                 URL: https://issues.apache.org/jira/browse/AIRFLOW-1152
             Project: Apache Airflow
          Issue Type: Bug
          Components: backfill
            Reporter: Dan Davydov


Backfills should have some kind of heartbeat mechanism that causes the scheduler to time out and fail their dagruns if e.g. the backfill is interrupted. Otherwise you run into the case where you have something like max_active_dagruns = 1 and a cancelled backrun that leaves its dagrun in a running state causes the whole dag to hang.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)