You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by "Gordon Ball (JIRA)" <ji...@apache.org> on 2018/09/03 06:45:00 UTC
[jira] [Updated] (AIRFLOW-2997) Support for clustered tables in
Bigquery hooks/operators
[ https://issues.apache.org/jira/browse/AIRFLOW-2997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Gordon Ball updated AIRFLOW-2997:
---------------------------------
Priority: Minor (was: Major)
> Support for clustered tables in Bigquery hooks/operators
> --------------------------------------------------------
>
> Key: AIRFLOW-2997
> URL: https://issues.apache.org/jira/browse/AIRFLOW-2997
> Project: Apache Airflow
> Issue Type: Improvement
> Components: gcp
> Reporter: Gordon Ball
> Priority: Minor
>
> Bigquery support for clustered tables was added (at GCP "Beta" level) on 2018-07-30. This feature allows load or table-creating query operations to request that data be stored sorted by a subset of columns, allowing more efficient (and potentially cheaper) subsequent queries.
> Support for specifying fields to cluster on should be added to at least the bigquery hook, load-from-GCS operator and query operator.
> Documentation: https://cloud.google.com/bigquery/docs/clustered-tables
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)