You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by "jack (JIRA)" <ji...@apache.org> on 2018/10/21 15:27:00 UTC

[jira] [Commented] (AIRFLOW-540) Allow BigQuery operators to specify default dataset

    [ https://issues.apache.org/jira/browse/AIRFLOW-540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16658263#comment-16658263 ] 

jack commented on AIRFLOW-540:
------------------------------

Specifying the default dataset is confusing. There are queries which run against multiple datasets.

In my opinion Specifying it on the SQL query is the way to go. 

> Allow BigQuery operators to specify default dataset
> ---------------------------------------------------
>
>                 Key: AIRFLOW-540
>                 URL: https://issues.apache.org/jira/browse/AIRFLOW-540
>             Project: Apache Airflow
>          Issue Type: Improvement
>          Components: contrib
>            Reporter: Sam McVeety
>            Priority: Minor
>
> BigQuery allows the specification of a defaultDataset (https://cloud.google.com/bigquery/docs/reference/v2/jobs/query), which can simplify and modularize the SQL being used.
> Perhaps a more general solution to this (and https://issues.apache.org/jira/browse/AIRFLOW-539) would be to support arbitrary kwargs to the various BigQueryHook methods.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)