You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@airflow.apache.org by "Aizhamal Nurmamat kyzy (JIRA)" <ji...@apache.org> on 2019/05/17 20:19:01 UTC

[jira] [Updated] (AIRFLOW-2988) GCP Dataflow hook should specifically run python2

     [ https://issues.apache.org/jira/browse/AIRFLOW-2988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Aizhamal Nurmamat kyzy updated AIRFLOW-2988:
--------------------------------------------

Moving to gcp component for component refactor.

> GCP Dataflow hook should specifically run python2
> -------------------------------------------------
>
>                 Key: AIRFLOW-2988
>                 URL: https://issues.apache.org/jira/browse/AIRFLOW-2988
>             Project: Apache Airflow
>          Issue Type: Improvement
>          Components: Dataflow, gcp, hooks
>            Reporter: Jimmy Cao
>            Priority: Major
>             Fix For: 1.10.3
>
>
> Currently the GCP dataflow hook invokes 'python' [here|https://github.com/apache/incubator-airflow/blob/c3939c8e721870d263997e7aeaebc28e678d544b/airflow/contrib/hooks/gcp_dataflow_hook.py#L239].  This can fail if the user's 'python' in PATH starts python 3, which Apache Beam does not yet support, (see BEAM-1251).
> It should be changed to 'python2' to ensure that Apache Beam is run with the correct version of Python. 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)