You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by gi...@apache.org on 2025/05/20 03:33:01 UTC

(beam) branch nightly-refs/heads/master updated (8c7ed02721e -> b2879858abe)

This is an automated email from the ASF dual-hosted git repository.

github-bot pushed a change to branch nightly-refs/heads/master
in repository https://gitbox.apache.org/repos/asf/beam.git


    from 8c7ed02721e Revert "use avro 1.12.0 (#34970)" (#34986)
     add 2cfeb3109d8 SnowflakeIO: filter on database and schema when searching for existing table (#34486)
     add 00f6e6ea4bf [Gradle] Patch testJavaVersion and java17Home for Dataflow runner v2 distroless integration test (#34998)
     add 9f6ecc64092 Support newer versions of PyArrow (#34892)
     add 00539f75f6e Fix audit header (#34997)
     add 0f4f98d600c [KafkaIO] Remove duplicate offset in range check (#34201)
     add 6bedaefaa79 Move Java Example distroless Dataflow to Java21 precommit (#35001)
     add 5dab4a599e1 use java 11 for yaml docs (#34995)
     add e35cc141772 Update Beam model protos with element metadata (#34971)
     add 3a6a5c12585 Always trigger update Python dependency on manual run (#35005)
     add 2fe5b3b3bd8 Log warning instead of raising an exception for unsupported pickle option (#34852)
     add 48adb76a3b2 Release documents update post 2.65.0 release (#35006)
     add 9c422ea0088 Deflake spark test
     add ac109ead1e0 Disable Spark 3.2 test
     add 7aed5c9e426 remove assert
     add c279623f902 Merge pull request #35000: Deflake spark test
     add ad4741c093f Update Python Dependencies (#35007)
     add 4aa604059dd Adding support for pyproject.toml file (resolves a part of #32380) (#34924)
     add 8893760eb28 Change ReadFromKafkaViaSDF to use Create instead of deprecated Impulse transform. (#34900)
     add b2879858abe force avro 1.11.4 for the expansion service (#34994)

No new revisions were added by this update.

Summary of changes:
 .github/trigger_files/beam_PostCommit_Python.json  |  3 +-
 .../beam_PostCommit_Python_Dependency.json         |  2 +-
 .../beam_PostCommit_Java_Examples_Dataflow_V2.yml  |  4 ++
 ...eam_PreCommit_Java_Examples_Dataflow_Java21.yml |  2 +-
 .github/workflows/build_release_candidate.yml      |  5 +-
 .github/workflows/update_python_dependencies.yml   |  3 +-
 CHANGES.md                                         |  1 +
 build.gradle.kts                                   |  1 -
 .../org/apache/beam/gradle/BeamModulePlugin.groovy |  1 +
 contributor-docs/release-guide.md                  | 10 +--
 .../beam/model/fn_execution/v1/beam_fn_api.proto   |  6 ++
 .../beam/model/pipeline/v1/beam_runner_api.proto   |  4 ++
 runners/spark/3/build.gradle                       |  6 +-
 .../StreamingTransformTranslatorTest.java          |  9 +--
 .../schemaio-expansion-service/build.gradle        |  6 ++
 .../extensions/sql/expansion-service/build.gradle  |  8 ++-
 sdks/java/io/expansion-service/build.gradle        |  3 +
 .../expansion-service/build.gradle                 |  8 ++-
 .../java/org/apache/beam/sdk/io/kafka/KafkaIO.java | 66 +++++++++--------
 .../beam/sdk/io/kafka/KafkaUnboundedReader.java    | 24 ++-----
 .../beam/sdk/io/kafka/ReadFromKafkaDoFn.java       | 41 ++---------
 .../beam/sdk/io/kafka/KafkaIOExternalTest.java     |  7 +-
 .../beam/sdk/io/kafka/ReadFromKafkaDoFnTest.java   | 10 ++-
 .../services/SnowflakeBatchServiceImpl.java        | 18 +++--
 .../apache_beam/internal/cloudpickle_pickler.py    |  6 +-
 .../internal/cloudpickle_pickler_test.py           |  6 +-
 sdks/python/apache_beam/io/parquetio_test.py       |  6 +-
 .../python/apache_beam/options/pipeline_options.py |  2 +-
 .../apache_beam/runners/portability/stager.py      | 37 ++++++----
 .../apache_beam/runners/portability/stager_test.py | 46 +++++++++++-
 .../container/py310/base_image_requirements.txt    | 84 ++++++++++++----------
 .../container/py311/base_image_requirements.txt    | 82 +++++++++++----------
 .../container/py312/base_image_requirements.txt    | 84 ++++++++++++----------
 .../container/py39/base_image_requirements.txt     | 74 ++++++++++---------
 sdks/python/setup.py                               |  3 +-
 sdks/python/test-suites/tox/py39/build.gradle      |  8 +++
 sdks/python/tox.ini                                |  4 +-
 37 files changed, 399 insertions(+), 291 deletions(-)