You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by "Lukas Kronsbein (JIRA)" <ji...@apache.org> on 2019/05/24 10:41:00 UTC

[jira] [Created] (AIRFLOW-4568) The ExternalTaskSensor should be configurable to raise an Airflow Exception in case the poked external task reaches a disallowed state, such as f.i. failed

Lukas Kronsbein created AIRFLOW-4568:
----------------------------------------

             Summary: The ExternalTaskSensor should be configurable to raise an Airflow Exception in case the poked external task reaches a disallowed state, such as f.i. failed
                 Key: AIRFLOW-4568
                 URL: https://issues.apache.org/jira/browse/AIRFLOW-4568
             Project: Apache Airflow
          Issue Type: Improvement
          Components: operators
    Affects Versions: 1.10.3
            Reporter: Lukas Kronsbein


_As an engineer, I would like to have the behavior of the ExternalTaskSensor changed_
_So that it fails in case the poked external_task_id fails_

*Therefore*
 * I suggest extending the behavior of the sensor to optionally also query the TaskInstance for disallowed states and raise an AirflowException if found. Currently, if the poked external task reaches a failed state, the sensor continues to poke and does not terminate

*Acceptance Criteria (from my pov)*
 * The class interface for ExternalTaskSensor is extended with an additional parameter, disallowed_states, which is an Optional List of airflow.utils.state.State
 * The poke method is expanded to count the number of rows from TaskInstance which met the filter criteria dag_id, task_id, disallowed_states and dttm_filter if disallowed_states is not None
 * If disallowed_states is not None and the above query returns a counter > 0, an Airflow Exception is thrown



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)