You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@airflow.apache.org by "Dan Sedov (JIRA)" <ji...@apache.org> on 2019/05/09 23:42:00 UTC

[jira] [Created] (AIRFLOW-4492) Dataproc operator does not capture error from create cluster failure

Dan Sedov created AIRFLOW-4492:
----------------------------------

             Summary: Dataproc operator does not capture error from create cluster failure
                 Key: AIRFLOW-4492
                 URL: https://issues.apache.org/jira/browse/AIRFLOW-4492
             Project: Apache Airflow
          Issue Type: Bug
          Components: operators
            Reporter: Dan Sedov
            Assignee: Dan Sedov


This line [1] captures the detail message as exception when cluster enters the ERROR state, however, Dataproc does not populate the detail field if cluster creation fails.

The correct behavior is to poll on Operation and report the error from the Operation, instead of polling on the cluster.

[[1] https://github.com/apache/airflow/blob/master/airflow/contrib/operators/dataproc_operator.py#L252|https://github.com/apache/airflow/blob/master/airflow/contrib/operators/dataproc_operator.py#L252]



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)