You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by gi...@apache.org on 2023/02/20 05:30:10 UTC
[beam] branch nightly-refs/heads/master updated (977e53104f4 -> 6667eb4741b)
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a change to branch nightly-refs/heads/master
in repository https://gitbox.apache.org/repos/asf/beam.git
from 977e53104f4 [prism] add windowing strategy (#25518)
add c160a081923 Fix Tensorflow intergration test model path (#25553)
add d652d054ecd [Go SDK]: Retrieve file size in CreateInitialRestriction in textio.Read (#25535)
add ca1ec257c4a [#24789][prism] internal/worker + tentative data (#25478)
add 6667eb4741b [#24789][prism] add preprocessor and test (#25520)
No new revisions were added by this update.
Summary of changes:
sdks/go/pkg/beam/io/textio/textio.go | 39 +-
.../pkg/beam/runners/prism/internal/engine/data.go | 23 +-
.../go/pkg/beam/runners/prism/internal/execute.go | 8 +-
.../pkg/beam/runners/prism/internal/preprocess.go | 148 ++++++++
.../beam/runners/prism/internal/preprocess_test.go | 181 +++++++++
.../beam/runners/prism/internal/worker/bundle.go | 114 ++++++
.../runners/prism/internal/worker/bundle_test.go | 52 +++
.../beam/runners/prism/internal/worker/worker.go | 421 +++++++++++++++++++++
.../runners/prism/internal/worker/worker_test.go | 281 ++++++++++++++
.../ml/inference/tensorflow_inference_it_test.py | 6 +-
sdks/python/tox.ini | 1 -
11 files changed, 1230 insertions(+), 44 deletions(-)
copy learning/katas/go/core_transforms/map/pardo_onetomany/pkg/task/task.go => sdks/go/pkg/beam/runners/prism/internal/engine/data.go (67%)
copy playground/backend/internal/db/entity/schema.go => sdks/go/pkg/beam/runners/prism/internal/execute.go (84%)
create mode 100644 sdks/go/pkg/beam/runners/prism/internal/preprocess.go
create mode 100644 sdks/go/pkg/beam/runners/prism/internal/preprocess_test.go
create mode 100644 sdks/go/pkg/beam/runners/prism/internal/worker/bundle.go
create mode 100644 sdks/go/pkg/beam/runners/prism/internal/worker/bundle_test.go
create mode 100644 sdks/go/pkg/beam/runners/prism/internal/worker/worker.go
create mode 100644 sdks/go/pkg/beam/runners/prism/internal/worker/worker_test.go