You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@airflow.apache.org by "Felix Yuan (JIRA)" <ji...@apache.org> on 2017/11/07 02:43:00 UTC

[jira] [Created] (AIRFLOW-1786) Upstream Sensor skipped but whole DAG fails

Felix Yuan created AIRFLOW-1786:
-----------------------------------

             Summary: Upstream Sensor skipped but whole DAG fails
                 Key: AIRFLOW-1786
                 URL: https://issues.apache.org/jira/browse/AIRFLOW-1786
             Project: Apache Airflow
          Issue Type: Bug
          Components: DAG
    Affects Versions: Airflow 1.8
            Reporter: Felix Yuan
            Priority: Minor


I have created a daily DAG, which first monitor whether a file is ready on FTP server, then execute an ETL operation. If someday the file is missing, this is expected, so I set the "soft_fail" as True to simply skipped the FTP sensor.

During execution, I see the task of "FTP sensor" is surely be skipped, but the whole DAG is marked as failed.

My expectation is the upstream task (FTP Sensor) is skipped, then all downstream tasks are skipped as well.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)