You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by "ASF subversion and git services (Jira)" <ji...@apache.org> on 2019/08/29 23:32:00 UTC

[jira] [Commented] (AIRFLOW-5104) Set default schedule for GCP Transfer operators

    [ https://issues.apache.org/jira/browse/AIRFLOW-5104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16919038#comment-16919038 ] 

ASF subversion and git services commented on AIRFLOW-5104:
----------------------------------------------------------

Commit fcfd55bccdc30f7dc0be78bf72a514353718c371 in airflow's branch refs/heads/v1-10-test from Joel Croteau
[ https://gitbox.apache.org/repos/asf?p=airflow.git;h=fcfd55b ]

[AIRFLOW-5104] Set default schedule for GCP Transfer operators (#5726)

cherry-picked from 1cf8bc4


> Set default schedule for GCP Transfer operators
> -----------------------------------------------
>
>                 Key: AIRFLOW-5104
>                 URL: https://issues.apache.org/jira/browse/AIRFLOW-5104
>             Project: Apache Airflow
>          Issue Type: Bug
>          Components: contrib, gcp
>    Affects Versions: 1.10.3
>            Reporter: Joel Croteau
>            Assignee: Joel Croteau
>            Priority: Major
>             Fix For: 1.10.5
>
>
>  The docstring for `airflow.contrib.operators.gcp_transfer_operator.S3ToGoogleCloudStorageTransferOperator` says of the `schedule` parameter:
> {noformat}
> Optional transfer service schedule;
>  If not set, run transfer job once as soon as the operator runs{noformat}
> This isn't the way the operator is actually implemented though. If `schedule` is unset, the operator provides to `schedule` parameter in the REST API call, which causes the API to return this error:
> {noformat}
> HttpError 400 when requesting https://storagetransfer.googleapis.com/v1/transferJobs?alt=json returned "Schedule was not specified."{noformat}
> It's not well-described in [the official documentation|https://cloud.google.com/storage-transfer/docs/reference/rest/v1/transferJobs], but it seems the REST API actually does require a `schedule` parameter to be provided, and fails if it isn't.
>  



--
This message was sent by Atlassian Jira
(v8.3.2#803003)