You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by "Aizhamal Nurmamat kyzy (JIRA)" <ji...@apache.org> on 2019/05/17 20:19:01 UTC
[jira] [Updated] (AIRFLOW-1608) GCP Dataflow hook missing pending
job state
[ https://issues.apache.org/jira/browse/AIRFLOW-1608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Aizhamal Nurmamat kyzy updated AIRFLOW-1608:
--------------------------------------------
Moving to gcp component for component refactor.
> GCP Dataflow hook missing pending job state
> -------------------------------------------
>
> Key: AIRFLOW-1608
> URL: https://issues.apache.org/jira/browse/AIRFLOW-1608
> Project: Apache Airflow
> Issue Type: Bug
> Components: contrib, Dataflow, gcp, hooks
> Reporter: Thomas Buida
> Assignee: Thomas Buida
> Priority: Major
> Fix For: 1.9.0
>
>
> The Dataflow hook does not handle the pending job state and throws an exception when it is encountered:
> {noformat}
> Exception: Google Cloud Dataflow job <job_name> was unknown state: JOB_STATE_PENDING
> {noformat}
> This causes Dataflow operator tasks to fail prematurely before even reaching one of the running, failed, done, etc... states.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)