You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by jr...@apache.org on 2023/05/10 17:30:17 UTC
[beam] branch master updated: Beam 2.47.0 Release Website Updates (#26439)
This is an automated email from the ASF dual-hosted git repository.
jrmccluskey pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/master by this push:
new c94ac97d0a7 Beam 2.47.0 Release Website Updates (#26439)
c94ac97d0a7 is described below
commit c94ac97d0a777a549f1eb98368b4700f6aeaa649
Author: Jack McCluskey <34...@users.noreply.github.com>
AuthorDate: Wed May 10 13:30:07 2023 -0400
Beam 2.47.0 Release Website Updates (#26439)
* Initial Update for 2.47.0 Release
* Add milestone link
* Add Storage Write API bug to known issues
* Update range
* Update issue link
* Move BQ write bug to bugfixes
* Change to archive references
---
CHANGES.md | 15 +-
website/www/site/config.toml | 2 +-
website/www/site/content/en/blog/beam-2.47.0.md | 197 +++++++++++++++++++++
.../www/site/content/en/get-started/downloads.md | 14 +-
website/www/site/data/authors.yml | 4 +
5 files changed, 216 insertions(+), 16 deletions(-)
diff --git a/CHANGES.md b/CHANGES.md
index 8abeb517cdf..d58c5189474 100644
--- a/CHANGES.md
+++ b/CHANGES.md
@@ -91,7 +91,7 @@
* ([#X](https://github.com/apache/beam/issues/X)).
-# [2.47.0] - Cut, Unreleased
+# [2.47.0] - 2023-05-10
## Highlights
@@ -99,7 +99,6 @@
## I/Os
-* Support for X source added (Java/Python) ([#X](https://github.com/apache/beam/issues/X)).
* BigQuery Storage Write API is now available in Python SDK via cross-language ([#21961](https://github.com/apache/beam/issues/21961)).
* Added HbaseIO support for writing RowMutations (ordered by rowkey) to Hbase (Java) ([#25830](https://github.com/apache/beam/issues/25830)).
* Added fileio transforms MatchFiles, MatchAll and ReadMatches (Go) ([#25779](https://github.com/apache/beam/issues/25779)).
@@ -124,18 +123,13 @@
## Deprecations
-* X behavior is deprecated and will be removed in X versions ([#X](https://github.com/apache/beam/issues/X)).
* Cloud Debugger support and its pipeline options are deprecated and will be removed in the next Beam version,
in response to the Google Cloud Debugger service [turning down](https://cloud.google.com/debugger/docs/deprecations).
(Java) ([#25959](https://github.com/apache/beam/issues/25959)).
## Bugfixes
-* Fixed X (Java/Python) ([#X](https://github.com/apache/beam/issues/X)).
-
-## Known Issues
-
-* ([#X](https://github.com/apache/beam/issues/X)).
+* BigQuery sink in STORAGE_WRITE_API mode in batch pipelines could result in data consistency issues during the handling of other unrelated transient errors for Beam SDKs 2.35.0 - 2.46.0 (inclusive). For more details see: https://github.com/apache/beam/issues/26521
# [2.46.0] - 2023-03-10
@@ -191,10 +185,6 @@
* Fixed X (Java/Python) ([#X](https://github.com/apache/beam/issues/X)).
-## Known Issues
-
-* ([#X](https://github.com/apache/beam/issues/X)).
-
# [2.45.0] - 2023-02-15
## I/Os
@@ -273,6 +263,7 @@
* Fixed Beam SQL CalciteUtils (Java) and Cross-language JdbcIO (Python) did not support JDBC CHAR/VARCHAR, BINARY/VARBINARY logical types ([#23747](https://github.com/apache/beam/issues/23747), [#23526](https://github.com/apache/beam/issues/23526)).
* Ensure iterated and emitted types are used with the generic register package are registered with the type and schema registries.(Go) ([#23889](https://github.com/apache/beam/pull/23889))
+
# [2.43.0] - 2022-11-17
## Highlights
diff --git a/website/www/site/config.toml b/website/www/site/config.toml
index 3f21c90e39d..73152cf7bc6 100644
--- a/website/www/site/config.toml
+++ b/website/www/site/config.toml
@@ -104,7 +104,7 @@ github_project_repo = "https://github.com/apache/beam"
[params]
description = "Apache Beam is an open source, unified model and set of language-specific SDKs for defining and executing data processing workflows, and also data ingestion and integration flows, supporting Enterprise Integration Patterns (EIPs) and Domain Specific Languages (DSLs). Dataflow pipelines simplify the mechanics of large-scale batch and streaming data processing and can run on a number of runtimes like Apache Flink, Apache Spark, and Google Cloud Dataflow (a cloud service). Be [...]
-release_latest = "2.46.0"
+release_latest = "2.47.0"
# The repository and branch where the files live in Github or Colab. This is used
# to serve and stage from your local branch, but publish to the master branch.
# e.g. https://github.com/{{< param branch_repo >}}/path/to/notebook.ipynb
diff --git a/website/www/site/content/en/blog/beam-2.47.0.md b/website/www/site/content/en/blog/beam-2.47.0.md
new file mode 100644
index 00000000000..d224782bb36
--- /dev/null
+++ b/website/www/site/content/en/blog/beam-2.47.0.md
@@ -0,0 +1,197 @@
+---
+title: "Apache Beam 2.47.0"
+date: 2023-05-10 12:00:00 -0500
+categories:
+ - blog
+ - release
+authors:
+ - jrmccluskey
+---
+<!--
+Licensed under the Apache License, Version 2.0 (the "License");
+you may not use this file except in compliance with the License.
+You may obtain a copy of the License at
+http://www.apache.org/licenses/LICENSE-2.0
+Unless required by applicable law or agreed to in writing, software
+distributed under the License is distributed on an "AS IS" BASIS,
+WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+See the License for the specific language governing permissions and
+limitations under the License.
+-->
+
+We are happy to present the new 2.47.0 release of Beam.
+This release includes both improvements and new functionality.
+See the [download page](/get-started/downloads/{$DOWNLOAD_ANCHOR}) for this release.
+
+<!--more-->
+
+For more information on changes in 2.47.0, check out the [detailed release notes](https://github.com/apache/beam/milestone/10).
+
+## Highlights
+
+* Apache Beam adds Python 3.11 support ([#23848](https://github.com/apache/beam/issues/23848)).
+
+## I/Os
+
+* Support for X source added (Java/Python) ([#X](https://github.com/apache/beam/issues/X)).
+* BigQuery Storage Write API is now available in Python SDK via cross-language ([#21961](https://github.com/apache/beam/issues/21961)).
+* Added HbaseIO support for writing RowMutations (ordered by rowkey) to Hbase (Java) ([#25830](https://github.com/apache/beam/issues/25830)).
+* Added fileio transforms MatchFiles, MatchAll and ReadMatches (Go) ([#25779](https://github.com/apache/beam/issues/25779)).
+* Add integration test for JmsIO + fix issue with multiple connections (Java) ([#25887](https://github.com/apache/beam/issues/25887)).
+
+## New Features / Improvements
+
+* The Flink runner now supports Flink 1.16.x ([#25046](https://github.com/apache/beam/issues/25046)).
+* Schema'd PTransforms can now be directly applied to Beam dataframes just like PCollections.
+ (Note that when doing multiple operations, it may be more efficient to explicitly chain the operations
+ like `df | (Transform1 | Transform2 | ...)` to avoid excessive conversions.)
+* The Go SDK adds new transforms periodic.Impulse and periodic.Sequence that extends support
+ for slowly updating side input patterns. ([#23106](https://github.com/apache/beam/issues/23106))
+* Python SDK now requires `protobuf>=4.21.1,<4.23.0` and no longer supports protobuf 3.x. ([#24599](https://github.com/apache/beam/pull/24599))
+* Several Google client libraries in Python SDK dependency chain were updated to latest available major versions. ([#24599](https://github.com/apache/beam/pull/24599))
+
+## Breaking Changes
+
+* If a main session fails to load, the pipeline will now fail at worker startup. ([#25401](https://github.com/apache/beam/issues/25401)).
+* Python pipeline options will now ignore unparsed command line flags prefixed with a single dash. ([#25943](https://github.com/apache/beam/issues/25943)).
+* The SmallestPerKey combiner now requires keyword-only arguments for specifying optional parameters, such as `key` and `reverse`. ([#25888](https://github.com/apache/beam/issues/25888)).
+
+## Deprecations
+
+* Cloud Debugger support and its pipeline options are deprecated and will be removed in the next Beam version,
+ in response to the Google Cloud Debugger service [turning down](https://cloud.google.com/debugger/docs/deprecations).
+ (Java) ([#25959](https://github.com/apache/beam/issues/25959)).
+
+## Bugfixes
+
+* BigQuery sink in STORAGE_WRITE_API mode in batch pipelines might result in data consistency issues during the handling of other unrelated transient errors for Beam SDKs 2.35.0 - 2.46.0 (inclusive). For more details see: https://github.com/apache/beam/issues/26521
+
+## List of Contributors
+
+According to git shortlog, the following people contributed to the 2.47.0 release. Thank you to all contributors!
+
+Ahmed Abualsaud
+
+Ahmet Altay
+
+Alexey Romanenko
+
+Amir Fayazi
+
+Amrane Ait Zeouay
+
+Anand Inguva
+
+Andrew Pilloud
+
+Andrey Kot
+
+Bjorn Pedersen
+
+Bruno Volpato
+
+Buqian Zheng
+
+Chamikara Jayalath
+
+ChangyuLi28
+
+Damon
+
+Danny McCormick
+
+Dmitry Repin
+
+George Ma
+
+Jack Dingilian
+
+Jack McCluskey
+
+Jasper Van den Bossche
+
+Jeremy Edwards
+
+Jiangjie (Becket) Qin
+
+Johanna Öjeling
+
+Juta Staes
+
+Kenneth Knowles
+
+Kyle Weaver
+
+Mattie Fu
+
+Moritz Mack
+
+Nick Li
+
+Oleh Borysevych
+
+Pablo Estrada
+
+Rebecca Szper
+
+Reuven Lax
+
+Reza Rokni
+
+Ritesh Ghorse
+
+Robert Bradshaw
+
+Robert Burke
+
+Saadat Su
+
+Saifuddin53
+
+Sam Rohde
+
+Shubham Krishna
+
+Svetak Sundhar
+
+Theodore Ni
+
+Thomas Gaddy
+
+Timur Sultanov
+
+Udi Meiri
+
+Valentyn Tymofieiev
+
+Xinyu Liu
+
+Yanan Hao
+
+Yi Hu
+
+Yuvi Panda
+
+andres-vv
+
+bochap
+
+dannikay
+
+darshan-sj
+
+dependabot[bot]
+
+harrisonlimh
+
+hnnsgstfssn
+
+jrmccluskey
+
+liferoad
+
+tvalentyn
+
+xianhualiu
+
+zhangskz
\ No newline at end of file
diff --git a/website/www/site/content/en/get-started/downloads.md b/website/www/site/content/en/get-started/downloads.md
index 6cc83fac00d..ddc57f31808 100644
--- a/website/www/site/content/en/get-started/downloads.md
+++ b/website/www/site/content/en/get-started/downloads.md
@@ -96,10 +96,18 @@ versions denoted `0.x.y`.
## Releases
+### 2.47.0 (2023-05-10)
+Official [source code download](https://downloads.apache.org/beam/2.47.0/apache-beam-2.47.0-source-release.zip).
+[SHA-512](https://downloads.apache.org/beam/2.47.0/apache-beam-2.47.0-source-release.zip.sha512).
+[signature](https://downloads.apache.org/beam/2.47.0/apache-beam-2.47.0-source-release.zip.asc).
+
+[Release notes](https://github.com/apache/beam/releases/tag/v2.47.0)
+[Blog post](/blog/beam-2.47.0).
+
### 2.46.0 (2023-03-10)
-Official [source code download](https://downloads.apache.org/beam/2.46.0/apache-beam-2.46.0-source-release.zip).
-[SHA-512](https://downloads.apache.org/beam/2.46.0/apache-beam-2.46.0-source-release.zip.sha512).
-[signature](https://downloads.apache.org/beam/2.46.0/apache-beam-2.46.0-source-release.zip.asc).
+Official [source code download](https://archive.apache.org/dist/beam/2.46.0/apache-beam-2.45.0-source-release.zip).
+[SHA-512](https://archive.apache.org/dist/beam/2.45.0/apache-beam-2.46.0-source-release.zip.sha512).
+[signature](https://archive.apache.org/dist/beam/2.45.0/apache-beam-2.46.0-source-release.zip.asc).
[Release notes](https://github.com/apache/beam/releases/tag/v2.46.0)
[Blog post](/blog/beam-2.46.0).
diff --git a/website/www/site/data/authors.yml b/website/www/site/data/authors.yml
index d36b36f5385..ec566a1b2b9 100644
--- a/website/www/site/data/authors.yml
+++ b/website/www/site/data/authors.yml
@@ -88,6 +88,10 @@ jphalip:
name: Julien Phalip
email: jphalip@google.com
twitter: julienphalip
+jrmccluskey:
+ name: Jack R. McCluskey
+ email: jrmccluskey@apache.org
+ twitter: jrmccluskey
kileysok:
name: Kiley Sok
email: kileysok@apache.org