You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by gi...@apache.org on 2025/05/20 03:33:01 UTC
(beam) branch nightly-refs/heads/master updated (8c7ed02721e -> b2879858abe)
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a change to branch nightly-refs/heads/master
in repository https://gitbox.apache.org/repos/asf/beam.git
from 8c7ed02721e Revert "use avro 1.12.0 (#34970)" (#34986)
add 2cfeb3109d8 SnowflakeIO: filter on database and schema when searching for existing table (#34486)
add 00f6e6ea4bf [Gradle] Patch testJavaVersion and java17Home for Dataflow runner v2 distroless integration test (#34998)
add 9f6ecc64092 Support newer versions of PyArrow (#34892)
add 00539f75f6e Fix audit header (#34997)
add 0f4f98d600c [KafkaIO] Remove duplicate offset in range check (#34201)
add 6bedaefaa79 Move Java Example distroless Dataflow to Java21 precommit (#35001)
add 5dab4a599e1 use java 11 for yaml docs (#34995)
add e35cc141772 Update Beam model protos with element metadata (#34971)
add 3a6a5c12585 Always trigger update Python dependency on manual run (#35005)
add 2fe5b3b3bd8 Log warning instead of raising an exception for unsupported pickle option (#34852)
add 48adb76a3b2 Release documents update post 2.65.0 release (#35006)
add 9c422ea0088 Deflake spark test
add ac109ead1e0 Disable Spark 3.2 test
add 7aed5c9e426 remove assert
add c279623f902 Merge pull request #35000: Deflake spark test
add ad4741c093f Update Python Dependencies (#35007)
add 4aa604059dd Adding support for pyproject.toml file (resolves a part of #32380) (#34924)
add 8893760eb28 Change ReadFromKafkaViaSDF to use Create instead of deprecated Impulse transform. (#34900)
add b2879858abe force avro 1.11.4 for the expansion service (#34994)
No new revisions were added by this update.
Summary of changes:
.github/trigger_files/beam_PostCommit_Python.json | 3 +-
.../beam_PostCommit_Python_Dependency.json | 2 +-
.../beam_PostCommit_Java_Examples_Dataflow_V2.yml | 4 ++
...eam_PreCommit_Java_Examples_Dataflow_Java21.yml | 2 +-
.github/workflows/build_release_candidate.yml | 5 +-
.github/workflows/update_python_dependencies.yml | 3 +-
CHANGES.md | 1 +
build.gradle.kts | 1 -
.../org/apache/beam/gradle/BeamModulePlugin.groovy | 1 +
contributor-docs/release-guide.md | 10 +--
.../beam/model/fn_execution/v1/beam_fn_api.proto | 6 ++
.../beam/model/pipeline/v1/beam_runner_api.proto | 4 ++
runners/spark/3/build.gradle | 6 +-
.../StreamingTransformTranslatorTest.java | 9 +--
.../schemaio-expansion-service/build.gradle | 6 ++
.../extensions/sql/expansion-service/build.gradle | 8 ++-
sdks/java/io/expansion-service/build.gradle | 3 +
.../expansion-service/build.gradle | 8 ++-
.../java/org/apache/beam/sdk/io/kafka/KafkaIO.java | 66 +++++++++--------
.../beam/sdk/io/kafka/KafkaUnboundedReader.java | 24 ++-----
.../beam/sdk/io/kafka/ReadFromKafkaDoFn.java | 41 ++---------
.../beam/sdk/io/kafka/KafkaIOExternalTest.java | 7 +-
.../beam/sdk/io/kafka/ReadFromKafkaDoFnTest.java | 10 ++-
.../services/SnowflakeBatchServiceImpl.java | 18 +++--
.../apache_beam/internal/cloudpickle_pickler.py | 6 +-
.../internal/cloudpickle_pickler_test.py | 6 +-
sdks/python/apache_beam/io/parquetio_test.py | 6 +-
.../python/apache_beam/options/pipeline_options.py | 2 +-
.../apache_beam/runners/portability/stager.py | 37 ++++++----
.../apache_beam/runners/portability/stager_test.py | 46 +++++++++++-
.../container/py310/base_image_requirements.txt | 84 ++++++++++++----------
.../container/py311/base_image_requirements.txt | 82 +++++++++++----------
.../container/py312/base_image_requirements.txt | 84 ++++++++++++----------
.../container/py39/base_image_requirements.txt | 74 ++++++++++---------
sdks/python/setup.py | 3 +-
sdks/python/test-suites/tox/py39/build.gradle | 8 +++
sdks/python/tox.ini | 4 +-
37 files changed, 399 insertions(+), 291 deletions(-)