You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by "desusaiteja (via GitHub)" <gi...@apache.org> on 2026/07/12 22:11:45 UTC
[PR] Add unit tests for BigQuery to SQL transfer base operator [airflow]
desusaiteja opened a new pull request, #69788:
URL: https://github.com/apache/airflow/pull/69788
Adds a dedicated unit test module for `airflow.providers.google.cloud.transfers.bigquery_to_sql`, which previously had no tests of its own — it is one of the missing provider test modules tracked in #35442.
The new `providers/google/tests/unit/google/cloud/transfers/test_bigquery_to_sql.py` covers the abstract `BigQueryToSqlBaseOperator` (the base for the BigQuery→MySQL/Postgres/MsSQL transfer operators) through a minimal concrete subclass:
- `dataset_table` parsing into `dataset_id`/`table_id`, including the `ValueError` for malformed values
- `BigQueryHook` construction with the operator's `gcp_conn_id`, `location`, and `impersonation_chain`
- `execute()` fetching from BigQuery and inserting every batch into the target SQL table with the right `target_fields`, `replace`, and `commit_every` arguments
- `persist_links()` being invoked with the task context
- `get_openlineage_facets_on_complete()` returning empty lineage when the BigQuery table cannot be fetched or the SQL hook provides no database info (the happy paths are already covered by the concrete operators' tests)
All 9 new tests pass locally, along with the existing bigquery_to_mysql/postgres/mssql test modules and the fast/manual prek static checks.
related: #35442
---
##### Was generative AI tooling used to co-author this PR?
- [X] Yes — Claude Code (Fable 5)
Generated-by: Claude Code (Fable 5) following [the guidelines](https://github.com/apache/airflow/blob/main/contributing-docs/05_pull_requests.rst#gen-ai-assisted-contributions)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] Add unit tests for BigQuery to SQL transfer base operator [airflow]
Posted by "desusaiteja (via GitHub)" <gi...@apache.org>.
desusaiteja commented on PR #69788:
URL: https://github.com/apache/airflow/pull/69788#issuecomment-5420943687
Hi @potiuk - could you please reopen this PR? I'm picking it back up and will fix the compat test failures, keeping it in draft until CI is green. Thanks!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] Add unit tests for BigQuery to SQL transfer base operator [airflow]
Posted by "potiuk (via GitHub)" <gi...@apache.org>.
potiuk closed pull request #69788: Add unit tests for BigQuery to SQL transfer base operator
URL: https://github.com/apache/airflow/pull/69788
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org