You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by "Mohammed Tameem (JIRA)" <ji...@apache.org> on 2018/06/20 05:56:00 UTC
[jira] [Created] (AIRFLOW-2649) subdag stopped scheduling tasks as
it got internally paused
Mohammed Tameem created AIRFLOW-2649:
----------------------------------------
Summary: subdag stopped scheduling tasks as it got internally paused
Key: AIRFLOW-2649
URL: https://issues.apache.org/jira/browse/AIRFLOW-2649
Project: Apache Airflow
Issue Type: Bug
Components: scheduler, subdag
Affects Versions: 1.9.0
Reporter: Mohammed Tameem
Fix For: Airflow 2.0
Attachments: main_dag.jpg, sub_dag.jpg, task_instance.jpg
I have a dag with many subdags in it (the actual dag is in the image below). The subdag operator randomly fails after waiting for a long time for the subdag task instance to execute.
After digging in for sometime in the airflow database, we found out that the subdag was marked paused thus scheduler ignoring all the downstream task instances of the subdag.
This issue seems to occur randomly.
I have attached all my findings in the attachments. I apologize for the abstract images (as all the names of the task instances have been removed as the task names are confidential). !main_dag.jpg!
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)