You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by "jack (JIRA)" <ji...@apache.org> on 2018/10/21 15:27:00 UTC
[jira] [Commented] (AIRFLOW-540) Allow BigQuery operators to
specify default dataset
[ https://issues.apache.org/jira/browse/AIRFLOW-540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16658263#comment-16658263 ]
jack commented on AIRFLOW-540:
------------------------------
Specifying the default dataset is confusing. There are queries which run against multiple datasets.
In my opinion Specifying it on the SQL query is the way to go.
> Allow BigQuery operators to specify default dataset
> ---------------------------------------------------
>
> Key: AIRFLOW-540
> URL: https://issues.apache.org/jira/browse/AIRFLOW-540
> Project: Apache Airflow
> Issue Type: Improvement
> Components: contrib
> Reporter: Sam McVeety
> Priority: Minor
>
> BigQuery allows the specification of a defaultDataset (https://cloud.google.com/bigquery/docs/reference/v2/jobs/query), which can simplify and modularize the SQL being used.
> Perhaps a more general solution to this (and https://issues.apache.org/jira/browse/AIRFLOW-539) would be to support arbitrary kwargs to the various BigQueryHook methods.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)