You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@airflow.apache.org by "Lenoj (Jira)" <ji...@apache.org> on 2019/10/04 11:06:00 UTC

[jira] [Work started] (AIRFLOW-5595) gcs_to_bq operator - Throws error when BQ dataset isn't located in US or EU region.

     [ https://issues.apache.org/jira/browse/AIRFLOW-5595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Work on AIRFLOW-5595 started by Lenoj.
--------------------------------------
> gcs_to_bq operator - Throws error when BQ dataset isn't located in US or EU region.
> -----------------------------------------------------------------------------------
>
>                 Key: AIRFLOW-5595
>                 URL: https://issues.apache.org/jira/browse/AIRFLOW-5595
>             Project: Apache Airflow
>          Issue Type: Bug
>          Components: gcp, operators
>    Affects Versions: 1.10.5
>            Reporter: Lenoj
>            Assignee: Lenoj
>            Priority: Major
>
>  I have my BQ dataset in "Asia-South1" region and tried using gcs_to_bq operator. I started seeing errors after calling the operator, when the hook tries to check the status of the job. I realized there is no way to pass "location" parameter to the underlying hook from the gcs_to_bq operator, which results in no job found error when the hook tries to get the status of the job.
> As per the doc([https://cloud.google.com/bigquery/docs/reference/rest/v2/jobs/get),] the geographic location of the job is required except for US and EU.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)