You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by "Feng Gao (Jira)" <ji...@apache.org> on 2020/02/21 20:25:00 UTC
[jira] [Commented] (AIRFLOW-6835)
GoogleCloudStorageToBigQueryOperator failed when loading empty csv file
[ https://issues.apache.org/jira/browse/AIRFLOW-6835?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17042156#comment-17042156 ]
Feng Gao commented on AIRFLOW-6835:
-----------------------------------
The issue is resolved by adding "autodetect='FALSE'," option to the operator.
> GoogleCloudStorageToBigQueryOperator failed when loading empty csv file
> -----------------------------------------------------------------------
>
> Key: AIRFLOW-6835
> URL: https://issues.apache.org/jira/browse/AIRFLOW-6835
> Project: Apache Airflow
> Issue Type: Bug
> Components: gcp
> Affects Versions: 1.10.6
> Environment: Google Composer Image version: composer-1.9.0-airflow-1.10.6
> Reporter: Feng Gao
> Priority: Major
>
> GoogleCloudStorageToBigQueryOperator failed when loading empty csv file (size 0).
> Found error in logs :
> Exception: BigQuery job failed. Final error was: \{'reason': 'invalidQuery', 'location': 'query', 'message': 'There are no column descriptions provided for table XXXX_ev_5GNTR3nPyPPZfamjrtfpgieU8fg6kU3A_8e8qCoEAMI_source'}.
> Re-ran the task succeeded after adding one row to the csv file.
>
> Google Composer Image version: composer-1.9.0-airflow-1.10.6
>
> The same dag works fine on Google Composer image version: composer-1.8.4-airflow-1.9.0
--
This message was sent by Atlassian Jira
(v8.3.4#803005)