You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by "Iuliia Volkova (JIRA)" <ji...@apache.org> on 2018/09/12 16:53:00 UTC
[jira] [Commented] (AIRFLOW-638) Added schema_update_options to
BigQueryBaseCursor and GoogleCloudStorageToBigQueryOperator
[ https://issues.apache.org/jira/browse/AIRFLOW-638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16612452#comment-16612452 ]
Iuliia Volkova commented on AIRFLOW-638:
----------------------------------------
[~ashb] , [~kaxilnaik] , please close this task. It's already done - [https://github.com/apache/incubator-airflow/pull/1891]
> Added schema_update_options to BigQueryBaseCursor and GoogleCloudStorageToBigQueryOperator
> ------------------------------------------------------------------------------------------
>
> Key: AIRFLOW-638
> URL: https://issues.apache.org/jira/browse/AIRFLOW-638
> Project: Apache Airflow
> Issue Type: New Feature
> Reporter: Giovanni Briggs
> Assignee: Giovanni Briggs
> Priority: Minor
>
> Was trying to upload data to a BigQuery table along with a change in my schema. The way that the GoogleCloudStorageToBigQueryOperator currently works, this is not possible, but BigQuery does support changing a table's schema as a side-effect of a load operation via the "schemaUpdateOptions" field: https://cloud.google.com/bigquery/docs/reference/rest/v2/jobs#configuration.load.schemaUpdateOptions
> Added schema_update_options as a parameter to both the GoogleCloudStorageToBigQueryOperator and consequently the BigQueryBaseCursor to enable use of the schemaUpdateOptions field during load operations.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)