[jira] [Created] (AIRFLOW-5114) TypeError when running S3ToGoogleCloudStorageTransferOperator or GoogleCloudStorageToGoogleCloudStorageTransferOperator with default arguments

["Joel Croteau (JIRA)" <ji...@apache.org>]

Joel Croteau created AIRFLOW-5114:
-------------------------------------

             Summary: TypeError when running S3ToGoogleCloudStorageTransferOperator or GoogleCloudStorageToGoogleCloudStorageTransferOperator with default arguments
                 Key: AIRFLOW-5114
                 URL: https://issues.apache.org/jira/browse/AIRFLOW-5114
             Project: Apache Airflow
          Issue Type: Bug
          Components: contrib, gcp
    Affects Versions: 1.10.3
            Reporter: Joel Croteau
            Assignee: Joel Croteau


When running `S3ToGoogleCloudStorageTransferOperator` or `GoogleCloudStorageToGoogleCloudStorageTransferOperator` with default arguments, you get the following `TypeError`:

 
{noformat}
[2019-08-05 04:13:19,873] {models.py:1796} ERROR - '>' not supported between instances of 'NoneType' and 'int'
Traceback (most recent call last)
  File "/usr/local/lib/airflow/airflow/models.py", line 1664, in _run_raw_tas
    result = task_copy.execute(context=context
  File "/home/airflow/gcs/dags/dependencies/gcp_transfer_operator.py", line 675, in execut
    hook.wait_for_transfer_job(job, timeout=self.timeout
  File "/home/airflow/gcs/dags/dependencies/gcp_api_base_hook.py", line 188, in wrapper_decorato
    return func(self, *args, **kwargs
  File "/home/airflow/gcs/dags/dependencies/gcp_transfer_hook.py", line 390, in wait_for_transfer_jo
    while timeout > 0
TypeError: '>' not supported between instances of 'NoneType' and 'int{noformat}
This is because both operators default `timeout` to `None`, and `wait_for_transfer_job` assumes `timeout` is an integer. I have a fix I can submit.

 



--
This message was sent by Atlassian JIRA
(v7.6.14#76016)