You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by "Aizhamal Nurmamat kyzy (JIRA)" <ji...@apache.org> on 2019/05/17 22:19:05 UTC
[jira] [Updated] (AIRFLOW-2649) subdag stopped scheduling tasks as
it got internally paused
[ https://issues.apache.org/jira/browse/AIRFLOW-2649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Aizhamal Nurmamat kyzy updated AIRFLOW-2649:
--------------------------------------------
Labels: subdag (was: )
Component/s: operators
Adding 'operators' component and 'subdag' label for component refactor.
> subdag stopped scheduling tasks as it got internally paused
> -----------------------------------------------------------
>
> Key: AIRFLOW-2649
> URL: https://issues.apache.org/jira/browse/AIRFLOW-2649
> Project: Apache Airflow
> Issue Type: Bug
> Components: operators, scheduler, subdag
> Affects Versions: 1.9.0
> Reporter: Mohammed Tameem
> Priority: Major
> Labels: subdag
> Fix For: 2.0.0
>
> Attachments: main_dag.jpg, sub_dag.jpg, task_instance.jpg
>
>
> I have a dag with many subdags in it (the actual dag is in the image below). The subdag operator randomly fails after waiting for a long time for the subdag task instance to execute.
> After digging in for sometime in the airflow database, we found out that the subdag was marked paused thus scheduler ignoring all the downstream task instances of the subdag.
> This issue seems to occur randomly.
> I have attached all my findings in the attachments. I apologize for the abstract images (as all the names of the task instances have been removed as the task names are confidential). !main_dag.jpg!
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)