You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by ro...@apache.org on 2023/12/11 23:43:09 UTC
(beam) branch master updated (f93423009fd -> bdaec7a13ed)
This is an automated email from the ASF dual-hosted git repository.
robertwb pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git
from f93423009fd Save Job IDs of dataflow load tests (#29693)
add 75bce947ceb Add a runner capability for multimap keys values side input reading.
add ccd93a95a04 Plumb runner capabilities to Python workers.
add 5c879cc5c04 Toggle use of bulk multimap state read on runner capabilities.
new bdaec7a13ed Merge pull request #29695 Enable keys values multimap protocol based on runner capabilities.
The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
.../apache/beam/model/pipeline/v1/beam_runner_api.proto | 5 +++++
.../org/apache/beam/fn/harness/FnApiDoFnRunner.java | 4 ++++
.../beam/fn/harness/state/FnApiStateAccessor.java | 12 +++++++++++-
.../apache/beam/fn/harness/state/MultimapSideInput.java | 11 -----------
sdks/python/apache_beam/portability/common_urns.py | 2 ++
.../portability/fn_api_runner/worker_handlers.py | 9 ++++++++-
.../apache_beam/runners/worker/bundle_processor.py | 17 ++++++++++++++---
.../apache_beam/runners/worker/bundle_processor_test.py | 6 +++---
.../apache_beam/runners/worker/log_handler_test.py | 2 +-
sdks/python/apache_beam/runners/worker/sdk_worker.py | 6 ++++++
.../apache_beam/runners/worker/sdk_worker_main.py | 10 +++++-----
.../apache_beam/runners/worker/sdk_worker_test.py | 8 ++++----
sdks/python/gen_protos.py | 1 -
13 files changed, 63 insertions(+), 30 deletions(-)
(beam) 01/01: Merge pull request #29695 Enable keys values multimap protocol based on runner capabilities.
Posted by ro...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
robertwb pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git
commit bdaec7a13ed5362b60c8aa27ff7b16637c89316a
Merge: f93423009fd 5c879cc5c04
Author: Robert Bradshaw <ro...@gmail.com>
AuthorDate: Mon Dec 11 15:43:02 2023 -0800
Merge pull request #29695 Enable keys values multimap protocol based on runner capabilities.
.../apache/beam/model/pipeline/v1/beam_runner_api.proto | 5 +++++
.../org/apache/beam/fn/harness/FnApiDoFnRunner.java | 4 ++++
.../beam/fn/harness/state/FnApiStateAccessor.java | 12 +++++++++++-
.../apache/beam/fn/harness/state/MultimapSideInput.java | 11 -----------
sdks/python/apache_beam/portability/common_urns.py | 2 ++
.../portability/fn_api_runner/worker_handlers.py | 9 ++++++++-
.../apache_beam/runners/worker/bundle_processor.py | 17 ++++++++++++++---
.../apache_beam/runners/worker/bundle_processor_test.py | 6 +++---
.../apache_beam/runners/worker/log_handler_test.py | 2 +-
sdks/python/apache_beam/runners/worker/sdk_worker.py | 6 ++++++
.../apache_beam/runners/worker/sdk_worker_main.py | 10 +++++-----
.../apache_beam/runners/worker/sdk_worker_test.py | 8 ++++----
sdks/python/gen_protos.py | 1 -
13 files changed, 63 insertions(+), 30 deletions(-)