[jira] [Commented] (AIRFLOW-15) Remove GCloud from Airflow

["Barry Hart (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/AIRFLOW-15?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16279191#comment-16279191 ] 

Barry Hart commented on AIRFLOW-15:
-----------------------------------

Question: This change moved Airflow to using a library that Google no longer recommends (https://github.com/google/google-api-python-client/#google-cloud-platform-apis):
{quote}
If you're working with Google Cloud Platform APIs such as Datastore or Pub/Sub, consider using the Cloud Client Libraries for Python instead. These are the new and idiomatic Python libraries targeted specifically at Google Cloud Platform Services.
{quote}

Should this decision be revisited and possibly reversed? I am happy to open a new ticket, but wanted to raise the question here first for context.

> Remove GCloud from Airflow
> --------------------------
>
>                 Key: AIRFLOW-15
>                 URL: https://issues.apache.org/jira/browse/AIRFLOW-15
>             Project: Apache Airflow
>          Issue Type: Task
>          Components: gcp
>            Reporter: Chris Riccomini
>            Assignee: Chris Riccomini
>              Labels: gcp
>
> After speaking with Google, there was some concern about using the [gcloud-python|https://github.com/GoogleCloudPlatform/gcloud-python] library for Airflow. There are several concerns:
> # It's not clear (even to people at Google) what this library is, who owns it, etc.
> # It does not support all services (the way [google-api-python-client|https://github.com/google/google-api-python-client] does).
> # There are compatibility issues between google-api-python-client and gcloudpython.
> We currently support both, after libraries depending on which package you you install: {{airfow[gcp_api]}} or {{airflow[gcloud]}}. This ticket is to remove the {{airflow[gcloud]}} packaged, and all associated code.
> The main associated code, afaik, is the use of the {{gcloud}} library in the Google cloud storage hooks/operators--specifically for Google cloud storage Airfow logging.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)