You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@beam.apache.org by ro...@apache.org on 2022/11/10 17:10:51 UTC

[beam] 01/01: Merge pull request #23985 Support dynamic sharding in the worker.

This is an automated email from the ASF dual-hosted git repository.

robertwb pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git

commit 74f87b0282a23aa01ecb63288013311d207960aa
Merge: 38a85b288ad 383ea77bc98
Author: Robert Bradshaw <ro...@gmail.com>
AuthorDate: Thu Nov 10 09:10:37 2022 -0800

    Merge pull request #23985 Support dynamic sharding in the worker.

 .../python/apache_beam/options/pipeline_options.py | 11 +++
 .../runners/portability/fn_api_runner/execution.py | 13 +++-
 .../runners/portability/fn_api_runner/fn_runner.py | 68 +++++++++++++-----
 .../portability/fn_api_runner/fn_runner_test.py    | 28 ++++++++
 .../src/apache_beam/transforms/create.ts           | 13 +++-
 .../apache_beam/transforms/{create.ts => utils.ts} | 19 +++--
 sdks/typescript/src/apache_beam/worker/metrics.ts  | 54 +++++++++++---
 .../typescript/src/apache_beam/worker/operators.ts | 81 ++++++++++++++++++++-
 .../src/apache_beam/worker/pardo_context.ts        |  2 +-
 sdks/typescript/src/apache_beam/worker/worker.ts   | 83 +++++++++++++++++++---
 sdks/typescript/test/primitives_test.ts            | 70 +++++++++++++++++-
 11 files changed, 393 insertions(+), 49 deletions(-)