[jira] [Created] (AIRFLOW-6853) ExternalTaskSensor does not work with packaged DAGs

["Johannes Wienke (Jira)" <ji...@apache.org>]

Johannes Wienke created AIRFLOW-6853:
----------------------------------------

             Summary: ExternalTaskSensor does not work with packaged DAGs
                 Key: AIRFLOW-6853
                 URL: https://issues.apache.org/jira/browse/AIRFLOW-6853
             Project: Apache Airflow
          Issue Type: Bug
          Components: operators
    Affects Versions: 1.10.9
            Reporter: Johannes Wienke


The current implementation of ExternalTaskSensor uses the file location of a DAG to determine if it still exists. This is realized by the following code fragment:

{code:python}
                if not os.path.exists(dag_to_wait.fileloc):
                    raise AirflowException('The external DAG '
                                           '{} was deleted.'.format(self.external_dag_id)
{code}

In case the DAG to check is part of a Zip archive, fileloc looks something like: {{/usr/local/airflow/dags/analytics.zip/create_keyframes.py}}. This can obviously not be checked with {{os.path.exists}} and therefore the sensor is currently unable to handle packaged DAGs at all.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)