You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by yh...@apache.org on 2023/07/20 14:45:41 UTC
[beam] branch master updated: Update releases 2.33.0 and 2.34.0 to include broken BQ copy jobs in batch as a known issue (#27563)
This is an automated email from the ASF dual-hosted git repository.
yhu pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/master by this push:
new 3d501ee9dc2 Update releases 2.33.0 and 2.34.0 to include broken BQ copy jobs in batch as a known issue (#27563)
3d501ee9dc2 is described below
commit 3d501ee9dc208af2efef009daa98c49819b73ddc
Author: Ahmed Abualsaud <65...@users.noreply.github.com>
AuthorDate: Thu Jul 20 14:45:34 2023 +0000
Update releases 2.33.0 and 2.34.0 to include broken BQ copy jobs in batch as a known issue (#27563)
* update release docs
* add error description and workaround
* update
* add java
* fix whitespace
---
website/www/site/content/en/blog/beam-2.33.0.md | 3 +++
website/www/site/content/en/blog/beam-2.34.0.md | 6 ++++++
2 files changed, 9 insertions(+)
diff --git a/website/www/site/content/en/blog/beam-2.33.0.md b/website/www/site/content/en/blog/beam-2.33.0.md
index 8e7237591d1..d2afd7a79bc 100644
--- a/website/www/site/content/en/blog/beam-2.33.0.md
+++ b/website/www/site/content/en/blog/beam-2.33.0.md
@@ -79,6 +79,9 @@ notes](https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12319527
* Spark 2.x users will need to update Spark's Jackson runtime dependencies (`spark.jackson.version`) to at least version 2.9.2, due to Beam updating its dependencies.
* See a full list of open [issues that affect](https://issues.apache.org/jira/issues/?jql=project%20%3D%20BEAM%20AND%20affectedVersion%20%3D%202.33.0%20ORDER%20BY%20priority%20DESC%2C%20updated%20DESC) this version.
* Go SDK jobs may produce "Failed to deduce Step from MonitoringInfo" messages following successful job execution. The messages are benign and don't indicate job failure. These are due to not yet handling PCollection metrics.
+* Large Java BigQueryIO writes with the FILE_LOADS method will fail in batch mode (specifically, when copy jobs are used).
+ This results in the error message: `IllegalArgumentException: Attempting to access unknown side input`.
+ Please upgrade to a newer version (> 2.34.0) or use another write method (e.g. `STORAGE_WRITE_API`).
## List of Contributors
diff --git a/website/www/site/content/en/blog/beam-2.34.0.md b/website/www/site/content/en/blog/beam-2.34.0.md
index 2f335a86fd8..288496aaa80 100644
--- a/website/www/site/content/en/blog/beam-2.34.0.md
+++ b/website/www/site/content/en/blog/beam-2.34.0.md
@@ -61,6 +61,12 @@ notes](https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12319527
* Fixed error when importing the DataFrame API with pandas 1.0.x installed ([BEAM-12945](https://issues.apache.org/jira/browse/BEAM-12945)).
* Fixed top.SmallestPerKey implementation in the Go SDK ([BEAM-12946](https://issues.apache.org/jira/browse/BEAM-12946)).
+### Known Issues
+
+* Large Java BigQueryIO writes with the FILE_LOADS method will fail in batch mode (specifically, when copy jobs are used).
+ This results in the error message: `IllegalArgumentException: Attempting to access unknown side input`.
+ Please upgrade to a newer version (> 2.34.0) or use another write method (e.g. `STORAGE_WRITE_API`).
+
## List of Contributors
According to git shortlog, the following people contributed to the 2.34.0 release. Thank you to all contributors!