You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by "Ash Berlin-Taylor (Jira)" <ji...@apache.org> on 2019/10/16 15:12:03 UTC
[jira] [Reopened] (AIRFLOW-5114) TypeError when running
S3ToGoogleCloudStorageTransferOperator or
GoogleCloudStorageToGoogleCloudStorageTransferOperator with default
arguments
[ https://issues.apache.org/jira/browse/AIRFLOW-5114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Ash Berlin-Taylor reopened AIRFLOW-5114:
----------------------------------------
> TypeError when running S3ToGoogleCloudStorageTransferOperator or GoogleCloudStorageToGoogleCloudStorageTransferOperator with default arguments
> ----------------------------------------------------------------------------------------------------------------------------------------------
>
> Key: AIRFLOW-5114
> URL: https://issues.apache.org/jira/browse/AIRFLOW-5114
> Project: Apache Airflow
> Issue Type: Bug
> Components: contrib, gcp
> Affects Versions: 1.10.3
> Reporter: Joel Croteau
> Assignee: Joel Croteau
> Priority: Major
> Fix For: 1.10.6
>
>
> When running `S3ToGoogleCloudStorageTransferOperator` or `GoogleCloudStorageToGoogleCloudStorageTransferOperator` with default arguments, you get the following `TypeError`:
>
> {noformat}
> [2019-08-05 04:13:19,873] {models.py:1796} ERROR - '>' not supported between instances of 'NoneType' and 'int'
> Traceback (most recent call last)
> File "/usr/local/lib/airflow/airflow/models.py", line 1664, in _run_raw_tas
> result = task_copy.execute(context=context
> File "/home/airflow/gcs/dags/dependencies/gcp_transfer_operator.py", line 675, in execut
> hook.wait_for_transfer_job(job, timeout=self.timeout
> File "/home/airflow/gcs/dags/dependencies/gcp_api_base_hook.py", line 188, in wrapper_decorato
> return func(self, *args, **kwargs
> File "/home/airflow/gcs/dags/dependencies/gcp_transfer_hook.py", line 390, in wait_for_transfer_jo
> while timeout > 0
> TypeError: '>' not supported between instances of 'NoneType' and 'int{noformat}
> This is because both operators default `timeout` to `None`, and `wait_for_transfer_job` assumes `timeout` is an integer. I have a fix I can submit.
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)