You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by gi...@apache.org on 2023/02/20 05:30:10 UTC

[beam] branch nightly-refs/heads/master updated (977e53104f4 -> 6667eb4741b)

This is an automated email from the ASF dual-hosted git repository.

github-bot pushed a change to branch nightly-refs/heads/master
in repository https://gitbox.apache.org/repos/asf/beam.git


    from 977e53104f4 [prism] add windowing strategy (#25518)
     add c160a081923 Fix Tensorflow intergration test model path (#25553)
     add d652d054ecd [Go SDK]: Retrieve file size in CreateInitialRestriction in textio.Read (#25535)
     add ca1ec257c4a [#24789][prism] internal/worker + tentative data (#25478)
     add 6667eb4741b [#24789][prism] add preprocessor and test (#25520)

No new revisions were added by this update.

Summary of changes:
 sdks/go/pkg/beam/io/textio/textio.go               |  39 +-
 .../pkg/beam/runners/prism/internal/engine/data.go |  23 +-
 .../go/pkg/beam/runners/prism/internal/execute.go  |   8 +-
 .../pkg/beam/runners/prism/internal/preprocess.go  | 148 ++++++++
 .../beam/runners/prism/internal/preprocess_test.go | 181 +++++++++
 .../beam/runners/prism/internal/worker/bundle.go   | 114 ++++++
 .../runners/prism/internal/worker/bundle_test.go   |  52 +++
 .../beam/runners/prism/internal/worker/worker.go   | 421 +++++++++++++++++++++
 .../runners/prism/internal/worker/worker_test.go   | 281 ++++++++++++++
 .../ml/inference/tensorflow_inference_it_test.py   |   6 +-
 sdks/python/tox.ini                                |   1 -
 11 files changed, 1230 insertions(+), 44 deletions(-)
 copy learning/katas/go/core_transforms/map/pardo_onetomany/pkg/task/task.go => sdks/go/pkg/beam/runners/prism/internal/engine/data.go (67%)
 copy playground/backend/internal/db/entity/schema.go => sdks/go/pkg/beam/runners/prism/internal/execute.go (84%)
 create mode 100644 sdks/go/pkg/beam/runners/prism/internal/preprocess.go
 create mode 100644 sdks/go/pkg/beam/runners/prism/internal/preprocess_test.go
 create mode 100644 sdks/go/pkg/beam/runners/prism/internal/worker/bundle.go
 create mode 100644 sdks/go/pkg/beam/runners/prism/internal/worker/bundle_test.go
 create mode 100644 sdks/go/pkg/beam/runners/prism/internal/worker/worker.go
 create mode 100644 sdks/go/pkg/beam/runners/prism/internal/worker/worker_test.go