You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@beam.apache.org by "jrmccluskey (via GitHub)" <gi...@apache.org> on 2026/09/29 17:58:33 UTC
[PR] [Gemini] GCP BigQuery IO Modern Client Migration [beam]
jrmccluskey opened a new pull request, #40340:
URL: https://github.com/apache/beam/pull/40340
Migrates Python BigQuery IO usage to the modern client, with the legacy apitools-generated client available via passing `--experiments=use_legacy_bigquery_client` or `--experiments=use_legacy_bq_client`. Also adds documentation on the compatibility shims introduced in #39998 (but these are unlikely to be used.)
Part of #37261
------------------------
Thank you for your contribution! Follow this checklist to help us incorporate your contribution quickly and easily:
- [ ] Mention the appropriate issue in your description (for example: `addresses #123`), if applicable. This will automatically add a link to the pull request in the issue. If you would like the issue to automatically close on merging the pull request, comment `fixes #<ISSUE NUMBER>` instead.
- [ ] Update `CHANGES.md` with noteworthy changes.
- [ ] If this contribution is large, please file an Apache [Individual Contributor License Agreement](https://www.apache.org/licenses/icla.pdf).
See the [Contributor Guide](https://beam.apache.org/contribute) for more tips on [how to make review process smoother](https://github.com/apache/beam/blob/master/CONTRIBUTING.md#make-the-reviewers-job-easier).
To check the build health, please visit [https://github.com/apache/beam/blob/master/.test-infra/BUILD_STATUS.md](https://github.com/apache/beam/blob/master/.test-infra/BUILD_STATUS.md)
GitHub Actions Tests Status (on master branch)
------------------------------------------------------------------------------------------------
[](https://github.com/apache/beam/actions?query=workflow%3A%22Build+python+source+distribution+and+wheels%22+branch%3Amaster+event%3Aschedule)
[](https://github.com/apache/beam/actions?query=workflow%3A%22Python+Tests%22+branch%3Amaster+event%3Aschedule)
[](https://github.com/apache/beam/actions?query=workflow%3A%22Java+Tests%22+branch%3Amaster+event%3Aschedule)
[](https://github.com/apache/beam/actions?query=workflow%3A%22Go+tests%22+branch%3Amaster+event%3Aschedule)
See [CI.md](https://github.com/apache/beam/blob/master/CI.md) for more information about GitHub Actions CI or the [workflows README](https://github.com/apache/beam/blob/master/.github/workflows/README.md) to see a list of phrases to trigger workflows.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [Gemini] GCP BigQuery IO Modern Client Migration [beam]
Posted by "jrmccluskey (via GitHub)" <gi...@apache.org>.
jrmccluskey closed pull request #40340: [Gemini] GCP BigQuery IO Modern Client Migration
URL: https://github.com/apache/beam/pull/40340
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [Gemini] GCP BigQuery IO Modern Client Migration [beam]
Posted by "codecov[bot] (via GitHub)" <gi...@apache.org>.
codecov[bot] commented on PR #40340:
URL: https://github.com/apache/beam/pull/40340#issuecomment-5897116386
## [Codecov](https://app.codecov.io/gh/apache/beam/pull/40340?dropdown=coverage&src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) Report
:x: Patch coverage is `48.89317%` with `531 lines` in your changes missing coverage. Please review.
:white_check_mark: Project coverage is 56.12%. Comparing base ([`22a237b`](https://app.codecov.io/gh/apache/beam/commit/22a237be9f525e73df689ffe25cd6750c356b8c6?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)) to head ([`98d1909`](https://app.codecov.io/gh/apache/beam/commit/98d1909e5eabefac0ed024a0635bf054fec52474?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)).
:warning: Report is 123 commits behind head on master.
| [Files with missing lines](https://app.codecov.io/gh/apache/beam/pull/40340?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Patch % | Lines |
|---|---|---|
| [sdks/python/apache\_beam/io/gcp/bigquery\_tools.py](https://app.codecov.io/gh/apache/beam/pull/40340?src=pr&el=tree&filepath=sdks%2Fpython%2Fapache_beam%2Fio%2Fgcp%2Fbigquery_tools.py&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-c2Rrcy9weXRob24vYXBhY2hlX2JlYW0vaW8vZ2NwL2JpZ3F1ZXJ5X3Rvb2xzLnB5) | 48.77% | [440 Missing :warning: ](https://app.codecov.io/gh/apache/beam/pull/40340?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
| [...thon/apache\_beam/io/gcp/bigquery\_change\_history.py](https://app.codecov.io/gh/apache/beam/pull/40340?src=pr&el=tree&filepath=sdks%2Fpython%2Fapache_beam%2Fio%2Fgcp%2Fbigquery_change_history.py&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-c2Rrcy9weXRob24vYXBhY2hlX2JlYW0vaW8vZ2NwL2JpZ3F1ZXJ5X2NoYW5nZV9oaXN0b3J5LnB5) | 26.19% | [31 Missing :warning: ](https://app.codecov.io/gh/apache/beam/pull/40340?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
| [sdks/python/apache\_beam/io/gcp/bigquery.py](https://app.codecov.io/gh/apache/beam/pull/40340?src=pr&el=tree&filepath=sdks%2Fpython%2Fapache_beam%2Fio%2Fgcp%2Fbigquery.py&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-c2Rrcy9weXRob24vYXBhY2hlX2JlYW0vaW8vZ2NwL2JpZ3F1ZXJ5LnB5) | 44.44% | [30 Missing :warning: ](https://app.codecov.io/gh/apache/beam/pull/40340?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
| [...python/apache\_beam/io/gcp/bigquery\_schema\_tools.py](https://app.codecov.io/gh/apache/beam/pull/40340?src=pr&el=tree&filepath=sdks%2Fpython%2Fapache_beam%2Fio%2Fgcp%2Fbigquery_schema_tools.py&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-c2Rrcy9weXRob24vYXBhY2hlX2JlYW0vaW8vZ2NwL2JpZ3F1ZXJ5X3NjaGVtYV90b29scy5weQ==) | 70.00% | [12 Missing :warning: ](https://app.codecov.io/gh/apache/beam/pull/40340?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
| [...s/python/apache\_beam/io/gcp/bigquery\_file\_loads.py](https://app.codecov.io/gh/apache/beam/pull/40340?src=pr&el=tree&filepath=sdks%2Fpython%2Fapache_beam%2Fio%2Fgcp%2Fbigquery_file_loads.py&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-c2Rrcy9weXRob24vYXBhY2hlX2JlYW0vaW8vZ2NwL2JpZ3F1ZXJ5X2ZpbGVfbG9hZHMucHk=) | 47.36% | [10 Missing :warning: ](https://app.codecov.io/gh/apache/beam/pull/40340?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
| [...ython/apache\_beam/io/gcp/bigquery\_read\_internal.py](https://app.codecov.io/gh/apache/beam/pull/40340?src=pr&el=tree&filepath=sdks%2Fpython%2Fapache_beam%2Fio%2Fgcp%2Fbigquery_read_internal.py&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-c2Rrcy9weXRob24vYXBhY2hlX2JlYW0vaW8vZ2NwL2JpZ3F1ZXJ5X3JlYWRfaW50ZXJuYWwucHk=) | 58.33% | [5 Missing :warning: ](https://app.codecov.io/gh/apache/beam/pull/40340?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
| [...ython/apache\_beam/io/gcp/tests/bigquery\_matcher.py](https://app.codecov.io/gh/apache/beam/pull/40340?src=pr&el=tree&filepath=sdks%2Fpython%2Fapache_beam%2Fio%2Fgcp%2Ftests%2Fbigquery_matcher.py&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-c2Rrcy9weXRob24vYXBhY2hlX2JlYW0vaW8vZ2NwL3Rlc3RzL2JpZ3F1ZXJ5X21hdGNoZXIucHk=) | 40.00% | [3 Missing :warning: ](https://app.codecov.io/gh/apache/beam/pull/40340?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
<details><summary>Additional details and impacted files</summary>
```diff
@@ Coverage Diff @@
## master #40340 +/- ##
============================================
- Coverage 57.25% 56.12% -1.13%
+ Complexity 3695 2290 -1405
============================================
Files 1200 1122 -78
Lines 194194 178833 -15361
Branches 3889 1486 -2403
============================================
- Hits 111183 100377 -10806
+ Misses 79406 75935 -3471
+ Partials 3605 2521 -1084
```
| [Flag](https://app.codecov.io/gh/apache/beam/pull/40340/flags?src=pr&el=flags&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | |
|---|---|---|
| [python](https://app.codecov.io/gh/apache/beam/pull/40340/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `79.30% <48.89%> (-0.53%)` | :arrow_down: |
Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#carryforward-flags-in-the-pull-request-comment) to find out more.
</details>
[:umbrella: View full report in Codecov by Harness](https://app.codecov.io/gh/apache/beam/pull/40340?dropdown=coverage&src=pr&el=continue&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache).
:loudspeaker: Have feedback on the report? [Share it here](https://about.codecov.io/codecov-pr-comment-feedback/?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache).
<details><summary> :rocket: New features to boost your workflow: </summary>
- :snowflake: [Test Analytics](https://docs.codecov.com/docs/test-analytics): Detect flaky tests, report on failures, and find test suite problems.
- :package: [JS Bundle Analysis](https://docs.codecov.com/docs/javascript-bundle-analysis): Save yourself from yourself by tracking and limiting bundle sizes in JS merges.
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org