You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by "Mohammed Tameem (JIRA)" <ji...@apache.org> on 2018/06/20 05:56:00 UTC

[jira] [Created] (AIRFLOW-2649) subdag stopped scheduling tasks as it got internally paused

Mohammed Tameem created AIRFLOW-2649:
----------------------------------------

             Summary: subdag stopped scheduling tasks as it got internally paused
                 Key: AIRFLOW-2649
                 URL: https://issues.apache.org/jira/browse/AIRFLOW-2649
             Project: Apache Airflow
          Issue Type: Bug
          Components: scheduler, subdag
    Affects Versions: 1.9.0
            Reporter: Mohammed Tameem
             Fix For: Airflow 2.0
         Attachments: main_dag.jpg, sub_dag.jpg, task_instance.jpg

I have a dag with many subdags in it (the actual dag is in the image below). The subdag operator randomly fails after waiting for a long time for the subdag task instance to execute.

After digging in for sometime in the airflow database, we found out that the subdag was marked paused thus scheduler ignoring all the downstream task instances of the subdag.

This issue seems to occur randomly.

I have attached all my findings in the attachments. I apologize for the abstract images (as all the names of the task instances have been removed as the task names are confidential). !main_dag.jpg!



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)