[jira] [Updated] (AIRFLOW-1142) SubDAG Tasks Not Executed Even Though All Dependencies Met

["Joe Schmid (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/AIRFLOW-1142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Joe Schmid updated AIRFLOW-1142:
--------------------------------
    Attachment: SubDAGOperatorTaskLog-DEBUG.txt

It took a bunch of attempts, but on the 8th manually triggered dagrun I observed the same issue while I had DEBUG logging enabled. Here's the log of the subdag operator task that fails to run one of the tasks. You'll see the same issue as before -- it logs "Dependencies all met for <TaskInstance: Test_Nested_SubDAG.level1_subdag.Level1_Task1" over and over without executing it.

> SubDAG Tasks Not Executed Even Though All Dependencies Met
> ----------------------------------------------------------
>
>                 Key: AIRFLOW-1142
>                 URL: https://issues.apache.org/jira/browse/AIRFLOW-1142
>             Project: Apache Airflow
>          Issue Type: Bug
>          Components: subdag
>    Affects Versions: 1.8.1
>         Environment: 1.8.1rc1+incubating, Celery
>            Reporter: Joe Schmid
>            Priority: Blocker
>         Attachments: 2017-04-24T23-20-38-776547, SubDAGOperatorTaskLog-DEBUG.txt, Test_Nested_SubDAG_0.png, Test_Nested_SubDAG_1-Zoomed.png, test_nested_subdag.py
>
>
> Testing on 1.8.1rc1, we noticed that tasks in subdags were not getting executed even though all dependencies had been met.
> We were able to create a simple test DAG that re-creates the issue. Attached is a test DAG, the log file of the subdag operator that shows it fails to run even though dependencies are met, and screenshots of what the UI looks like.
> This is definitely a regression as we have many similarly constructed DAGs that have been running successfully on a pre-v1.8 version (a fork of 1.7.1.3+master) for some time.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)