You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@beam.apache.org by "mukeshbhandarkar (via GitHub)" <gi...@apache.org> on 2026/09/04 17:19:35 UTC
[PR] Document Python BigQuery CDC record format [beam]
mukeshbhandarkar opened a new pull request, #40021:
URL: https://github.com/apache/beam/pull/40021
## What does this PR do?
Documents the Python BigQuery Change Data Capture (CDC) input format for `WriteToBigQuery`.
The new documentation explains:
- the required `STORAGE_WRITE_API`, `use_at_least_once`, and `use_cdc_writes` settings
- primary key requirements
- the expected `row_mutation_info` / `record` PCollection structure
- `UPSERT` and `DELETE` mutation types
- `change_sequence_number`
- how Beam maps mutation metadata to BigQuery `_CHANGE_TYPE` and `_CHANGE_SEQUENCE_NUMBER`
- dictionary input requirements
The `use_cdc_writes` Python API documentation is also clarified.
Fixes #39768
## Testing
- `git diff --check`
- Python 3.12 compilation
- Verified Hugo shortcode delimiters
- Confirmed only the intended documentation/API docstring files changed
I did not run `./gradlew :website:testWebsite` locally because it requires building the website environment and related dependencies that are not available in my local setup.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] Document Python BigQuery CDC record format [beam]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #40021:
URL: https://github.com/apache/beam/pull/40021#issuecomment-5544970138
Checks are failing. Will not request review until checks are succeeding. If you'd like to override that behavior, comment `assign set of reviewers`
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] Document Python BigQuery CDC record format [beam]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #40021:
URL: https://github.com/apache/beam/pull/40021#issuecomment-5598702211
Assigning reviewers:
R: @tvalentyn for label python.
R: @Abacn for label website.
Note: If you would like to opt out of this review, comment `assign to next reviewer`.
Available commands:
- `stop reviewer notifications` - opt out of the automated review tooling
- `remind me after tests pass` - tag the comment author after tests pass
- `waiting on author` - shift the attention set back to the author (any comment or push by the author will return the attention set to the reviewers)
The PR bot will only process comments in the main thread (not review comments).
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] Document Python BigQuery CDC record format [beam]
Posted by "tvalentyn (via GitHub)" <gi...@apache.org>.
tvalentyn merged PR #40021:
URL: https://github.com/apache/beam/pull/40021
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org