You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by gi...@apache.org on 2022/07/28 04:53:34 UTC

[beam] branch nightly-refs/heads/master updated (edd915d6956 -> b0b9c680255)

This is an automated email from the ASF dual-hosted git repository.

github-bot pushed a change to branch nightly-refs/heads/master
in repository https://gitbox.apache.org/repos/asf/beam.git


    from edd915d6956 [#22051]: Add read_time support to Google Cloud Datastore connector (#22052)
     add d3ef59b625b 21730 fix offset resetting (#22450)
     add 0760f13c4a5 Bump google.golang.org/api from 0.88.0 to 0.89.0 in /sdks (#22464)
     add 694a6669baf Upgrades pip before installing Beam for Python default expansion service (#22462)
     add df5cdc8c4de [Go SDK]: Plumb allowed lateness to execution (#22476)
     add 8652c452419 Replace distutils with supported modules. (#22456)
     add 9158b19f83d Restrict google-api-core
     add d7395ab18ed Regenerate the container dependencies.
     add 505b5b723b0 Restrict google-api-core and regenerate container dependencies. #22481
     add 9e7cc7cfd76 Fixes #22438. Ensure that WindmillStateReader completes all batched read futures on exceptions.  Also improve decoder exceptions to only affect the corresponding state not the rest of batched reads.
     add c581b4dc6bd Merge pull request #22461: Fixes #22438. Ensure that WindmillStateReader completes all batched read futures on exceptions
     add cd5f88abbb5 [22369] Default Metrics for Executable Stages in Samza Runner (#22370)
     add d51b497fb22 Moving to 2.42.0-SNAPSHOT on master branch.
     add b0b9c680255 Remove stripping of step name. Replace removing only suffix step name (#22415)

No new revisions were added by this update.

Summary of changes:
 .github/workflows/build_wheels.yml                 |   2 +-
 CHANGES.md                                         |   1 +
 .../org/apache/beam/gradle/BeamModulePlugin.groovy |   3 +-
 gradle.properties                                  |   4 +-
 .../dataflow/worker/WindmillStateReader.java       | 109 ++++++++------
 .../dataflow/worker/WindmillStateReaderTest.java   | 161 ++++++++++++++++++++-
 runners/samza/build.gradle                         |   1 +
 .../samza/metrics/SamzaMetricsContainer.java       |   9 ++
 .../apache/beam/runners/samza/runtime/DoFnOp.java  |   3 +
 .../runners/samza/runtime/SamzaDoFnRunners.java    |  57 +++++++-
 .../apache/beam/runners/samza/util/DoFnUtils.java  |  75 ++++++++++
 .../beam/runners/samza/util/DoFnUtilsTest.java     |  84 +++++++++++
 sdks/go.mod                                        |   2 +-
 sdks/go.sum                                        |   4 +-
 sdks/go/pkg/beam/core/core.go                      |   2 +-
 sdks/go/pkg/beam/core/runtime/graphx/translate.go  |   4 +-
 .../sdk/extensions/python/bootstrap_beam_venv.py   |  17 ++-
 sdks/java/io/kafka/build.gradle                    |   1 +
 .../beam/sdk/io/kafka/ReadFromKafkaDoFn.java       |   5 +-
 .../org/apache/beam/sdk/io/kafka/KafkaIOIT.java    | 101 +++++++++++++
 .../examples/complete/juliaset/setup.py            |   2 +-
 .../apache_beam/runners/portability/stager.py      |   4 +-
 .../testing/load_tests/load_test_metrics_utils.py  |   7 +-
 sdks/python/apache_beam/version.py                 |   2 +-
 sdks/python/container/Dockerfile                   |   2 +
 .../container/py37/base_image_requirements.txt     |  63 ++++----
 .../container/py38/base_image_requirements.txt     |  65 +++++----
 .../container/py39/base_image_requirements.txt     |  65 +++++----
 sdks/python/setup.py                               |  16 +-
 .../sdks/python-pipeline-dependencies.md           |   2 +-
 30 files changed, 700 insertions(+), 173 deletions(-)
 create mode 100644 runners/samza/src/main/java/org/apache/beam/runners/samza/util/DoFnUtils.java
 create mode 100644 runners/samza/src/test/java/org/apache/beam/runners/samza/util/DoFnUtilsTest.java