You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by "Feng Gao (Jira)" <ji...@apache.org> on 2020/02/21 20:27:00 UTC
[jira] [Closed] (AIRFLOW-6835) GoogleCloudStorageToBigQueryOperator
failed when loading empty csv file
[ https://issues.apache.org/jira/browse/AIRFLOW-6835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Feng Gao closed AIRFLOW-6835.
-----------------------------
Resolution: Not A Problem
In Airflow 1.10.3 one of {{schema_fields}}, {{schema_object}}, or {{autodetect}} must be specified. See:
[https://github.com/apache/airflow/blob/1.10.3/airflow/contrib/operators/gcs_to_bq.py#L217-L218]
> GoogleCloudStorageToBigQueryOperator failed when loading empty csv file
> -----------------------------------------------------------------------
>
> Key: AIRFLOW-6835
> URL: https://issues.apache.org/jira/browse/AIRFLOW-6835
> Project: Apache Airflow
> Issue Type: Bug
> Components: gcp
> Affects Versions: 1.10.6
> Environment: Google Composer Image version: composer-1.9.0-airflow-1.10.6
> Reporter: Feng Gao
> Priority: Major
>
> GoogleCloudStorageToBigQueryOperator failed when loading empty csv file (size 0).
> Found error in logs :
> Exception: BigQuery job failed. Final error was: \{'reason': 'invalidQuery', 'location': 'query', 'message': 'There are no column descriptions provided for table XXXX_ev_5GNTR3nPyPPZfamjrtfpgieU8fg6kU3A_8e8qCoEAMI_source'}.
> Re-ran the task succeeded after adding one row to the csv file.
>
> Google Composer Image version: composer-1.9.0-airflow-1.10.6
>
> The same dag works fine on Google Composer image version: composer-1.8.4-airflow-1.9.0
--
This message was sent by Atlassian Jira
(v8.3.4#803005)