You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by "Yu Ishikawa (JIRA)" <ji...@apache.org> on 2018/01/27 01:13:00 UTC
[jira] [Updated] (AIRFLOW-2039) BigQueryOperator supports priority
property
[ https://issues.apache.org/jira/browse/AIRFLOW-2039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Yu Ishikawa updated AIRFLOW-2039:
---------------------------------
Description:
h3. Goals
- Add priority property to BigQueryOperator
h3. Overview
BigQuery has some quota. for instance Maximum concurrent slots per project for on-demand pricing. In my opinion, some company would like to reduce the slots usage as much as possible. It would be great to use batch mode of BigQuery.
- [https://cloud.google.com/bigquery/quotas]
- [https://cloud.google.com/bigquery/docs/reference/rest/v2/jobs#configuration.query.priority]
was:
h3. Goals
- Add priority property to BigQueryOperator
h3. Overview
BigQuery has some quota. for instance Maximum concurrent slots per project for on-demand pricing. In my opinion, some company would like to reduce the slots usage as much as possible. It would be great to use batch mode of BigQuery.
- https://cloud.google.com/bigquery/quotas
- https://cloud.google.com/bigquery/docs/reference/rest/v2/jobs#configuration.query.priority
> BigQueryOperator supports priority property
> -------------------------------------------
>
> Key: AIRFLOW-2039
> URL: https://issues.apache.org/jira/browse/AIRFLOW-2039
> Project: Apache Airflow
> Issue Type: Improvement
> Components: gcp
> Affects Versions: Airflow 2.0
> Reporter: Yu Ishikawa
> Priority: Minor
>
> h3. Goals
> - Add priority property to BigQueryOperator
> h3. Overview
> BigQuery has some quota. for instance Maximum concurrent slots per project for on-demand pricing. In my opinion, some company would like to reduce the slots usage as much as possible. It would be great to use batch mode of BigQuery.
>
> - [https://cloud.google.com/bigquery/quotas]
> - [https://cloud.google.com/bigquery/docs/reference/rest/v2/jobs#configuration.query.priority]
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)