You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by "Will Hudgins (Jira)" <ji...@apache.org> on 2020/04/01 01:11:00 UTC

[jira] [Commented] (AIRFLOW-6876) Add method to BigQueryHook and corresponding operator to get tables

    [ https://issues.apache.org/jira/browse/AIRFLOW-6876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17072283#comment-17072283 ] 

Will Hudgins commented on AIRFLOW-6876:
---------------------------------------

[~TV4Fun] What do you think about just querying on the table INFORMATION_SCHEMA, as documented in [https://cloud.google.com/bigquery/docs/information-schema-tables] ? 

> Add method to BigQueryHook and corresponding operator to get tables
> -------------------------------------------------------------------
>
>                 Key: AIRFLOW-6876
>                 URL: https://issues.apache.org/jira/browse/AIRFLOW-6876
>             Project: Apache Airflow
>          Issue Type: Improvement
>          Components: gcp
>    Affects Versions: 1.10.9
>            Reporter: Joel Croteau
>            Assignee: Joel Croteau
>            Priority: Major
>
> We have methods to get datasets, to list tables, and to get data from tables, but we don't actually have anything to get actual table metadata like schema. This seems a rather glaring omission and would add a lot of usefulness to the BigQuery integration.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)