You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by sc...@apache.org on 2024/06/11 09:14:18 UTC
(beam) branch scwhittle-update-bq-docs created (now 9dfbc22fae9)
This is an automated email from the ASF dual-hosted git repository.
scwhittle pushed a change to branch scwhittle-update-bq-docs
in repository https://gitbox.apache.org/repos/asf/beam.git
at 9dfbc22fae9 Remove notes now that Dataflow v2 supports BQ autosharding
This branch includes the following new commits:
new 9dfbc22fae9 Remove notes now that Dataflow v2 supports BQ autosharding
The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
(beam) 01/01: Remove notes now that Dataflow v2 supports BQ autosharding
Posted by sc...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
scwhittle pushed a commit to branch scwhittle-update-bq-docs
in repository https://gitbox.apache.org/repos/asf/beam.git
commit 9dfbc22fae9fc767ad2e7a744af8c31bd5dc99b9
Author: Sam Whittle <sc...@users.noreply.github.com>
AuthorDate: Tue Jun 11 11:14:11 2024 +0200
Remove notes now that Dataflow v2 supports BQ autosharding
---
.../www/site/content/en/documentation/io/built-in/google-bigquery.md | 4 ----
1 file changed, 4 deletions(-)
diff --git a/website/www/site/content/en/documentation/io/built-in/google-bigquery.md b/website/www/site/content/en/documentation/io/built-in/google-bigquery.md
index 50fd5b8258d..d49e9bac949 100644
--- a/website/www/site/content/en/documentation/io/built-in/google-bigquery.md
+++ b/website/www/site/content/en/documentation/io/built-in/google-bigquery.md
@@ -789,9 +789,6 @@ BigQuery Storage Write API for Python SDK currently has some limitations on supp
{{< paragraph class="language-py" >}}
**Note:** If you want to run WriteToBigQuery with Storage Write API from the source code, you need to run `./gradlew :sdks:java:io:google-cloud-platform:expansion-service:build` to build the expansion-service jar. If you are running from a released Beam SDK, the jar is already included.
-
-**Note:** Auto sharding is not currently supported for Python's Storage Write API exactly-once mode on DataflowRunner.
-
{{< /paragraph >}}
#### Exactly-once semantics
@@ -883,7 +880,6 @@ explicitly enable this using [`withAutoSharding`](https://beam.apache.org/releas
`STORAGE_WRITE_API` defaults to dynamic sharding when
`numStorageWriteApiStreams` is set to 0 or is unspecified.
-***Note:*** Auto sharding with `STORAGE_WRITE_API` is supported by Dataflow, but **not** on Runner v2.
{{< /paragraph >}}
When using `STORAGE_WRITE_API`, the `PCollection` returned by