You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by "cceasy (via GitHub)" <gi...@apache.org> on 2023/09/21 06:21:36 UTC

[GitHub] [airflow] cceasy opened a new issue, #34513: Airflow Google Provider BigQueryIntervalCheckOperator miss project_id

cceasy opened a new issue, #34513:
URL: https://github.com/apache/airflow/issues/34513

   ### Apache Airflow version
   
   main (development)
   
   ### What happened
   
   When we use BigQueryIntervalCheckOperator to check the data in big query, we need to submit a bq job, but there is no way to define the bq job project id, it extract the project id from the gcp_conn_id hook. But we may NOT have permission to submit bq job to that project, so the job would fail.
   
   ### What you think should happen instead
   
   we should enable pass the bq job project id so that the underlying bq job could success.
   
   ### How to reproduce
   
   use the operator with a gcp connection that the correspond service account does not have permission to submit bq job to the connection project.
   
   ### Operating System
   
   Linux
   
   ### Versions of Apache Airflow Providers
   
   apache-airflow-providers-google==10.5.0
   
   ### Deployment
   
   Google Cloud Composer
   
   ### Deployment details
   
    composer-2.4.1-airflow-2.5.3 
   
   ### Anything else
   
   we need to be able to define the project id here https://github.com/apache/airflow/blob/main/airflow/providers/google/cloud/operators/bigquery.py#L563
   <img width="901" alt="image" src="https://github.com/apache/airflow/assets/6096155/d0e9cb0e-1a05-4ed1-a52e-65a76a69fc31">
   
   
   ### Are you willing to submit PR?
   
   - [X] Yes I am willing to submit a PR!
   
   ### Code of Conduct
   
   - [X] I agree to follow this project's [Code of Conduct](https://github.com/apache/airflow/blob/main/CODE_OF_CONDUCT.md)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [airflow] eladkal closed issue #34513: Airflow Google Provider BigQueryIntervalCheckOperator miss project_id

Posted by "eladkal (via GitHub)" <gi...@apache.org>.
eladkal closed issue #34513: Airflow Google Provider BigQueryIntervalCheckOperator miss project_id
URL: https://github.com/apache/airflow/issues/34513


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [airflow] Zhenye-Na commented on issue #34513: Airflow Google Provider BigQueryIntervalCheckOperator miss project_id

Posted by "Zhenye-Na (via GitHub)" <gi...@apache.org>.
Zhenye-Na commented on issue #34513:
URL: https://github.com/apache/airflow/issues/34513#issuecomment-1732212432

   Could you assign this issue to me as I am working on this actively.
   
   Thanks!


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [airflow] boring-cyborg[bot] commented on issue #34513: Airflow Google Provider BigQueryIntervalCheckOperator miss project_id

Posted by "boring-cyborg[bot] (via GitHub)" <gi...@apache.org>.
boring-cyborg[bot] commented on issue #34513:
URL: https://github.com/apache/airflow/issues/34513#issuecomment-1728924561

   Thanks for opening your first issue here! Be sure to follow the issue template! If you are willing to raise PR to address this issue please do so, no need to wait for approval.
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [airflow] hussein-awala commented on issue #34513: Airflow Google Provider BigQueryIntervalCheckOperator miss project_id

Posted by "hussein-awala (via GitHub)" <gi...@apache.org>.
hussein-awala commented on issue #34513:
URL: https://github.com/apache/airflow/issues/34513#issuecomment-1732283555

   @Zhenye-Na assigned you.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [airflow] eladkal commented on issue #34513: Airflow Google Provider BigQueryIntervalCheckOperator miss project_id

Posted by "eladkal (via GitHub)" <gi...@apache.org>.
eladkal commented on issue #34513:
URL: https://github.com/apache/airflow/issues/34513#issuecomment-1733934416

   Fixed in: https://github.com/apache/airflow/pull/34573


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org