You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by "Lukas Kronsbein (JIRA)" <ji...@apache.org> on 2019/05/24 10:41:00 UTC
[jira] [Created] (AIRFLOW-4568) The ExternalTaskSensor should be
configurable to raise an Airflow Exception in case the poked external task
reaches a disallowed state, such as f.i. failed
Lukas Kronsbein created AIRFLOW-4568:
----------------------------------------
Summary: The ExternalTaskSensor should be configurable to raise an Airflow Exception in case the poked external task reaches a disallowed state, such as f.i. failed
Key: AIRFLOW-4568
URL: https://issues.apache.org/jira/browse/AIRFLOW-4568
Project: Apache Airflow
Issue Type: Improvement
Components: operators
Affects Versions: 1.10.3
Reporter: Lukas Kronsbein
_As an engineer, I would like to have the behavior of the ExternalTaskSensor changed_
_So that it fails in case the poked external_task_id fails_
*Therefore*
* I suggest extending the behavior of the sensor to optionally also query the TaskInstance for disallowed states and raise an AirflowException if found. Currently, if the poked external task reaches a failed state, the sensor continues to poke and does not terminate
*Acceptance Criteria (from my pov)*
* The class interface for ExternalTaskSensor is extended with an additional parameter, disallowed_states, which is an Optional List of airflow.utils.state.State
* The poke method is expanded to count the number of rows from TaskInstance which met the filter criteria dag_id, task_id, disallowed_states and dttm_filter if disallowed_states is not None
* If disallowed_states is not None and the above query returns a counter > 0, an Airflow Exception is thrown
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)