You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by "Mustafa Gök (Jira)" <ji...@apache.org> on 2020/01/12 15:23:00 UTC
[jira] [Created] (AIRFLOW-6541) Use EmrJobFlowSensor for other
states
Mustafa Gök created AIRFLOW-6541:
------------------------------------
Summary: Use EmrJobFlowSensor for other states
Key: AIRFLOW-6541
URL: https://issues.apache.org/jira/browse/AIRFLOW-6541
Project: Apache Airflow
Issue Type: Improvement
Components: aws, contrib
Affects Versions: 1.10.7
Reporter: Mustafa Gök
Assignee: Mustafa Gök
Currently, EmrJobFlowSensor waits cluster to be terminated (state: "TERMINATED"). It can be used for other purposes if cluster states to be checked (i.e., NON_TERMINAL_STATES) can be passed to the operator.
For example, this sensor could be used to wait cluster to be ready (state: "RUNNING" or "WAITING").
--
This message was sent by Atlassian Jira
(v8.3.4#803005)