You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by "Benjamin (JIRA)" <ji...@apache.org> on 2019/07/04 13:07:00 UTC

[jira] [Commented] (AIRFLOW-4897) Location not used to create empty dataset by bigquery_hook cursor

    [ https://issues.apache.org/jira/browse/AIRFLOW-4897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16878636#comment-16878636 ] 

Benjamin commented on AIRFLOW-4897:
-----------------------------------

I understood the issue, it writes that datasetReference is settable in the next method 
{noformat}
 def create_empty_dataset(self, dataset_id="", project_id="", dataset_reference=None){noformat}
{"kind": string,"etag": string,"id": string,"selfLink": string,"datasetReference": {object ({{[DatasetReference|https://cloud.google.com/bigquery/docs/reference/rest/v2/datasets#DatasetReference]}})},"friendlyName": string,"description": string,"defaultTableExpirationMs": string,"defaultPartitionExpirationMs": string,"labels": {string: string,...},"access": [{"role": string,"userByEmail": string,"groupByEmail": string,"domain": string,"specialGroup": string,"iamMember": string,"view": {object ({{[TableReference|https://cloud.google.com/bigquery/docs/reference/rest/v2/tables#TableReference]}})}}],"creationTime": string,"lastModifiedTime": string,"location": string,"defaultEncryptionConfiguration": {object ({{[EncryptionConfiguration|https://cloud.google.com/bigquery/docs/reference/rest/v2/EncryptionConfiguration]}})}}

> Location not used to create empty dataset by bigquery_hook cursor
> -----------------------------------------------------------------
>
>                 Key: AIRFLOW-4897
>                 URL: https://issues.apache.org/jira/browse/AIRFLOW-4897
>             Project: Apache Airflow
>          Issue Type: Bug
>          Components: hooks
>    Affects Versions: 1.10.2, 1.10.3
>         Environment: composer-1.7.1-airflow-1.10.2
> Python 3
>            Reporter: Benjamin
>            Priority: Major
>
> {code:java}
> bq_cursor = BigQueryHook(use_legacy_sql=False,
>  bigquery_conn_id='google_cloud_default',
>  location=EU").get_conn().cursor()
> print(f'Location Cursor : {bq_cursor.location}') // EU is printed
> bq_cursor.create_empty_dataset(dataset_id, project_id){code}
> 'EU' is printed but my empty dataset has been created in location : 'US'.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)