You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@airflow.apache.org by "Gordon Ball (JIRA)" <ji...@apache.org> on 2018/09/03 06:45:00 UTC

[jira] [Created] (AIRFLOW-2997) Support for clustered tables in Bigquery hooks/operators

Gordon Ball created AIRFLOW-2997:
------------------------------------

             Summary: Support for clustered tables in Bigquery hooks/operators
                 Key: AIRFLOW-2997
                 URL: https://issues.apache.org/jira/browse/AIRFLOW-2997
             Project: Apache Airflow
          Issue Type: Improvement
          Components: gcp
            Reporter: Gordon Ball


Bigquery support for clustered tables was added (at GCP "Beta" level) on 2018-07-30. This feature allows load or table-creating query operations to request that data be stored sorted by a subset of columns, allowing more efficient (and potentially cheaper) subsequent queries.

 Support for specifying fields to cluster on should be added to at least the bigquery hook, load-from-GCS operator and query operator.

 Documentation: https://cloud.google.com/bigquery/docs/clustered-tables



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)