You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by "Ryan Yuan (JIRA)" <ji...@apache.org> on 2018/11/22 01:25:00 UTC
[jira] [Closed] (AIRFLOW-3318) Add a function to BigQueryHook to
check the existence of a dataset.
[ https://issues.apache.org/jira/browse/AIRFLOW-3318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Ryan Yuan closed AIRFLOW-3318.
------------------------------
Resolution: Won't Do
> Add a function to BigQueryHook to check the existence of a dataset.
> -------------------------------------------------------------------
>
> Key: AIRFLOW-3318
> URL: https://issues.apache.org/jira/browse/AIRFLOW-3318
> Project: Apache Airflow
> Issue Type: New Feature
> Components: contrib, gcp, hooks
> Affects Versions: 1.10.0
> Reporter: Ryan Yuan
> Assignee: Ryan Yuan
> Priority: Major
>
> To check the existence of a dataset in BigQuery, existing BigQueryHook only supports either 1) using get_datasets_list() to get all the datasets and then searching the target dataset from the list; or 2) using get_dataset().
> However, with get_dataset(), it raises AirflowException whenever an HttpError received. So it has no capabilities to determine if the dataset exists or not.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)