You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by "ASF subversion and git services (JIRA)" <ji...@apache.org> on 2017/09/13 16:33:00 UTC

[jira] [Commented] (AIRFLOW-1608) GCP Dataflow hook missing pending job state

    [ https://issues.apache.org/jira/browse/AIRFLOW-1608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16164914#comment-16164914 ] 

ASF subversion and git services commented on AIRFLOW-1608:
----------------------------------------------------------

Commit 653562e68a638e1e7c9060df347375748388daa9 in incubator-airflow's branch refs/heads/master from [~tjbiii]
[ https://git-wip-us.apache.org/repos/asf?p=incubator-airflow.git;h=653562e ]

[AIRFLOW-1608] Handle pending job state in GCP Dataflow hook

Closes #2607 from TJBIII/gcp_dataflow_hook


> GCP Dataflow hook missing pending job state
> -------------------------------------------
>
>                 Key: AIRFLOW-1608
>                 URL: https://issues.apache.org/jira/browse/AIRFLOW-1608
>             Project: Apache Airflow
>          Issue Type: Bug
>          Components: contrib, Dataflow, gcp, hooks
>            Reporter: Thomas Buida
>            Assignee: Thomas Buida
>
> The Dataflow hook does not handle the pending job state and throws an exception when it is encountered:
> {noformat}
> Exception: Google Cloud Dataflow job <job_name> was unknown state: JOB_STATE_PENDING
> {noformat}
> This causes Dataflow operator tasks to fail prematurely before even reaching one of the running, failed, done, etc... states.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)