You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by "Thomas Buida (JIRA)" <ji...@apache.org> on 2017/09/13 15:29:00 UTC
[jira] [Created] (AIRFLOW-1608) GCP Dataflow hook missing pending
job state
Thomas Buida created AIRFLOW-1608:
-------------------------------------
Summary: GCP Dataflow hook missing pending job state
Key: AIRFLOW-1608
URL: https://issues.apache.org/jira/browse/AIRFLOW-1608
Project: Apache Airflow
Issue Type: Bug
Components: contrib, Dataflow, gcp, hooks
Reporter: Thomas Buida
Assignee: Thomas Buida
The Dataflow hook does not handle the pending job state and throws an exception when it is encountered:
{noformat}
Exception: Google Cloud Dataflow job <job_name> was unknown state: JOB_STATE_PENDING
{noformat}
This causes Dataflow operator tasks to fail prematurely before even reaching one of the running, failed, done, etc... states.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)