You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@beam.apache.org by Robert Burke <lo...@apache.org> on 2024/02/14 19:50:31 UTC

Beam 2.54.0 Release

We are happy to present the new 2.54.0 release of Beam.
This release includes both improvements and new functionality.

For more information on changes in 2.54.0, check out the detailed release
notes(https://github.com/apache/beam/milestone/18).

## Highlights

* [Enrichment Transform](https://s.apache.org/enrichment-transform) along
with GCP BigTable handler added to Python SDK (
https://github.com/apache/beam/pull/30001).
* Beam Java Batch pipelines run on Google Cloud Dataflow will default to
the Portable (Runner V2) version  starting with this version. (All other
languages are already on Runner V2.)
  * This change is still rolling out to the Dataflow service, see the
Runner V2 documentation (https://cloud.google.com/dataflow/docs/runner-v2)
for how to enable or disable it intentionally.

## I/Os

* Added support for writing to BigQuery dynamic destinations with Python's
Storage Write API (https://github.com/apache/beam/pull/30045)
* Adding support for Tuples DataType in ClickHouse (Java) (
https://github.com/apache/beam/pull/29715).
* Added support for handling bad records to FileIO, TextIO, AvroIO (
https://github.com/apache/beam/pull/29670).
* Added support for handling bad records to BigtableIO (
https://github.com/apache/beam/pull/29885)

## New Features / Improvements

* [Enrichment Transform](https://s.apache.org/enrichment-transform) along
with GCP BigTable handler added to Python SDK ([#30001](
https://github.com/apache/beam/pull/30001)).

## Breaking Changes

* N/A

## Deprecations

* N/A

## Bugfixes

* Fixed a memory leak affecting some Go SDK since 2.46.0. (
https://github.com/apache/beam/pull/28142)

## Security Fixes

* N/A

## Known Issues

* N/A

From the blog post: https://beam.apache.org/blog/beam-2.54.0/

Thanks!

Robert Burke
Beam 2.54.0 Release Manager