[jira] [Commented] (AIRFLOW-1894) Rebase and migrate existing Airflow GCP operators to google-python-cloud

["Yannick Einsweiler (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/AIRFLOW-1894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16324249#comment-16324249 ] 

Yannick Einsweiler commented on AIRFLOW-1894:
---------------------------------------------

Wanted to submit a new operator for the Storage Transfer service to GCS sink (e.g. transfer from s3 without local copy).

Unfortunately this is not covered by google-cloud as yet so we must go the api route for both create-job operator, and check-job-status sensor.

> Rebase and migrate existing Airflow GCP operators to google-python-cloud
> ------------------------------------------------------------------------
>
>                 Key: AIRFLOW-1894
>                 URL: https://issues.apache.org/jira/browse/AIRFLOW-1894
>             Project: Apache Airflow
>          Issue Type: Improvement
>          Components: contrib
>    Affects Versions: Airflow 2.0
>            Reporter: Feng Lu
>            Assignee: Feng Lu
>            Priority: Minor
>
> [google-api-python-client|https://github.com/google/google-api-python-client] is in maintenance mode and it's recommended that [google-cloud-python|https://github.com/GoogleCloudPlatform/google-cloud-python] should be used whenever possible. Given that we don't have feature parity between the two libraries, this issue is created to track the long-term migration efforts moving from google-api-python-client to google-cloud-python. Here are some general guidelines we try to follow in this cleanup process:
> - add google-cloud-python dependency as part of gcp_api extra packages (make sure there is no dependency conflict between the two).
> - new operators shall be based on google-cloud-python if possible.
> - migrate existing GCP operators when the underlying GCP service is available in google-cloud-python. 



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)