You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by "Yohei Onishi (JIRA)" <ji...@apache.org> on 2019/04/11 12:24:00 UTC

[jira] [Updated] (AIRFLOW-3601) update operators to BigQuery to support location

     [ https://issues.apache.org/jira/browse/AIRFLOW-3601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Yohei Onishi updated AIRFLOW-3601:
----------------------------------
    Description: 
location support for BigQueryHook was merged by the PR 4324 [https://github.com/apache/incubator-airflow/pull/4324]

The following operators needs to be updated.
 * bigquery_check_operator.py
 ** 
BigQueryCheckOperator
 * bigquery_get_data.py
 ** 
BigQueryGetDataOperator
 *  bigquery_operator.py

 ** 
BigQueryOperator
BigQueryCreateEmptyTableOperator
BigQueryCreateExternalTableOperator
BigQueryDeleteDatasetOperator
BigQueryCreateEmptyDatasetOperator
 *  bigquery_table_delete_operator.py
 ** 
BigQueryTableDeleteOperator
 * bigquery_to_bigquery.py
 ** 
BigQueryToBigQueryOperator
 * bigquery_to_gcs.py
 ** 
BigQueryToCloudStorageOperator
 * gcs_to_bq.py
 ** 
GoogleCloudStorageToBigQueryOperator
 * bigquery_sensor.py
BigQueryTableSensor

The following operators does not require location since it does not use location internally
* bigquery_check_operator.py (BigQueryCheckOperator)
* bigquery_operator.py (BigQueryDeleteDatasetOperator): https://cloud.google.com/bigquery/docs/reference/rest/v2/datasets/delete
* bigquery_table_delete_operator.py (BigQueryTableDeleteOperator): https://cloud.google.com/bigquery/docs/reference/rest/v2/tables/delete


  was:
location support for BigQueryHook was merged by the PR 4324 [https://github.com/apache/incubator-airflow/pull/4324]

The following operators needs to be updated.
 * bigquery_check_operator.py
 ** 
BigQueryCheckOperator
 * bigquery_get_data.py
 ** 
BigQueryGetDataOperator
 *  bigquery_operator.py

 ** 
BigQueryOperator
BigQueryCreateEmptyTableOperator
BigQueryCreateExternalTableOperator
BigQueryDeleteDatasetOperator
BigQueryCreateEmptyDatasetOperator
 *  bigquery_table_delete_operator.py
 ** 
BigQueryTableDeleteOperator
 * bigquery_to_bigquery.py
 ** 
BigQueryToBigQueryOperator
 * bigquery_to_gcs.py
 ** 
BigQueryToCloudStorageOperator
 * gcs_to_bq.py
 ** 
GoogleCloudStorageToBigQueryOperator
 * bigquery_sensor.py
 ** 
BigQueryTableSensor


> update operators to BigQuery to support location
> ------------------------------------------------
>
>                 Key: AIRFLOW-3601
>                 URL: https://issues.apache.org/jira/browse/AIRFLOW-3601
>             Project: Apache Airflow
>          Issue Type: Task
>    Affects Versions: 1.10.1
>            Reporter: Yohei Onishi
>            Assignee: Yohei Onishi
>            Priority: Major
>
> location support for BigQueryHook was merged by the PR 4324 [https://github.com/apache/incubator-airflow/pull/4324]
> The following operators needs to be updated.
>  * bigquery_check_operator.py
>  ** 
> BigQueryCheckOperator
>  * bigquery_get_data.py
>  ** 
> BigQueryGetDataOperator
>  *  bigquery_operator.py
>  ** 
> BigQueryOperator
> BigQueryCreateEmptyTableOperator
> BigQueryCreateExternalTableOperator
> BigQueryDeleteDatasetOperator
> BigQueryCreateEmptyDatasetOperator
>  *  bigquery_table_delete_operator.py
>  ** 
> BigQueryTableDeleteOperator
>  * bigquery_to_bigquery.py
>  ** 
> BigQueryToBigQueryOperator
>  * bigquery_to_gcs.py
>  ** 
> BigQueryToCloudStorageOperator
>  * gcs_to_bq.py
>  ** 
> GoogleCloudStorageToBigQueryOperator
>  * bigquery_sensor.py
> BigQueryTableSensor
> The following operators does not require location since it does not use location internally
> * bigquery_check_operator.py (BigQueryCheckOperator)
> * bigquery_operator.py (BigQueryDeleteDatasetOperator): https://cloud.google.com/bigquery/docs/reference/rest/v2/datasets/delete
> * bigquery_table_delete_operator.py (BigQueryTableDeleteOperator): https://cloud.google.com/bigquery/docs/reference/rest/v2/tables/delete



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)