You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by "ASF GitHub Bot (Jira)" <ji...@apache.org> on 2019/12/11 08:14:00 UTC

[jira] [Commented] (AIRFLOW-5685) Loading AVRO file from GCS to BQ throwing ValueError

    [ https://issues.apache.org/jira/browse/AIRFLOW-5685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16993287#comment-16993287 ] 

ASF GitHub Bot commented on AIRFLOW-5685:
-----------------------------------------

potiuk commented on pull request #6355: [AIRFLOW-5685] Loading AVRO file from GCS to BQ throwing ValueError
URL: https://github.com/apache/airflow/pull/6355
 
 
   
 
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


> Loading AVRO file from GCS to BQ throwing ValueError
> ----------------------------------------------------
>
>                 Key: AIRFLOW-5685
>                 URL: https://issues.apache.org/jira/browse/AIRFLOW-5685
>             Project: Apache Airflow
>          Issue Type: Bug
>          Components: gcp
>    Affects Versions: 2.0.0
>            Reporter: Ryan Yuan
>            Assignee: Ryan Yuan
>            Priority: Critical
>
> Using {{GoogleCloudStorageToBigQueryOperator to load AVRO file is causing exception as follows:}}
>  
> {{Traceback (most recent call last):
>   File "/Users/ryanyuan/dev/airflow/airflow/models/taskinstance.py", line 932, in _run_raw_task
>     result = task_copy.execute(context=context)
>   File "/Users/ryanyuan/dev/airflow/airflow/operators/gcs_to_bq.py", line 293, in execute
>     encryption_configuration=self.encryption_configuration)
>   File "/Users/ryanyuan/dev/airflow/airflow/gcp/hooks/bigquery.py", line 1290, in run_load
>     backward_compatibility_configs)
>   File "/Users/ryanyuan/dev/airflow/airflow/gcp/hooks/bigquery.py", line 2374, in _validate_src_fmt_configs
>     .format(k, source_format))*ValueError: skipLeadingRows is not a valid src_fmt_configs for type AVRO.*}}
>  



--
This message was sent by Atlassian Jira
(v8.3.4#803005)