You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by gi...@apache.org on 2022/09/09 05:28:00 UTC
[beam] branch nightly-refs/heads/master updated (f3cdbbf13a1 -> 7a3ac2da4e0)
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a change to branch nightly-refs/heads/master
in repository https://gitbox.apache.org/repos/asf/beam.git
from f3cdbbf13a1 Moving to 2.43.0-SNAPSHOT on master branch.
add 4c3048b94e6 Use cloudpickle for Java Python transforms.
add cea122724c5 Merge pull request #23073 Use cloudpickle for Java Python transforms.
add 50a3bad014d clean up comments and register functional DoFn in wordcount.go (#23057)
add 9efa3787aef [Tour Of Beam][backend] integration tests and GA workflow (#23032)
add 269e0098f6b Decrease derby.locks.waitTimeout in jdbc unit test
add ab8a375acf4 Merge pull request #23019 from Abacn/jdbctestspeed
add 6da16cd461b Auto-cancel old unit test Actions Runs (#23095)
add f0cd27596e3 Merge pull request #23092 Cross-language tests in github actions.
add 41543c78181 Update CHANGES.md for 2.42.0 cut, and add 2.43.0 section (#23108)
add 10de67effd4 remove `"io/ioutil"` package (#23001)
add 70f8728cd66 Add one NER example to use a spaCy model with RunInference (#23035)
add 4f9040f02ee Bump google.golang.org/api from 0.94.0 to 0.95.0 in /sdks (#23062)
add e3ba8d87fb1 Implement JsonUtils (#22771)
add 7a3ac2da4e0 Support models returning a dictionary of outputs (#23087)
No new revisions were added by this update.
Summary of changes:
.github/workflows/build_playground_backend.yml | 6 +
.github/workflows/build_playground_frontend.yml | 5 +
.github/workflows/build_wheels.yml | 5 +
.github/workflows/go_tests.yml | 5 +
.github/workflows/java_tests.yml | 4 +
.github/workflows/local_env_tests.yml | 5 +
.github/workflows/python_tests.yml | 4 +
.github/workflows/tour_of_beam_backend.yml | 8 +-
.../workflows/tour_of_beam_backend_integration.yml | 96 ++++
.github/workflows/typescript_tests.yml | 39 ++
CHANGES.md | 34 +-
build.gradle.kts | 3 +
.../notebooks/beam-ml/run_custom_inference.ipynb | 572 +++++++++++++++++++++
learning/tour-of-beam/backend/docker-compose.yml | 4 +-
learning/tour-of-beam/backend/function.go | 1 +
.../entity.go => integration_tests/api.go} | 41 +-
.../backend/integration_tests/client.go | 67 +++
.../backend/integration_tests/function_test.go | 148 ++++++
.../backend/integration_tests/local.sh | 55 ++
.../backend/internal/fs_content/load_test.go | 6 +-
.../backend/internal/storage/image/Dockerfile | 2 -
.../backend/internal/storage/image/index.yaml | 29 --
.../backend/internal/storage/index.yaml | 20 +
.../backend/samples/api/get_unit_content.json | 18 +-
.../backend/samples/api/get_unit_content_full.json | 15 +
.../java/module 1/unit-challenge/description.md | 2 +-
.../java/module 1/unit-challenge/hint1.md | 2 +-
.../java/module 1/unit-challenge/hint2.md | 2 +-
.../java/module 2/unit-challenge/description.md | 2 +-
.../java/module 2/unit-challenge/hint1.md | 2 +-
.../java/module 2/unit-challenge/hint2.md | 2 +-
.../module 1/group/unit-challenge/description.md | 2 +-
.../python/module 1/group/unit-challenge/hint1.md | 2 +-
.../python/module 1/group/unit-challenge/hint2.md | 2 +-
sdks/go.mod | 2 +-
sdks/go.sum | 4 +-
sdks/go/cmd/specialize/main.go | 3 +-
sdks/go/container/boot_test.go | 11 +-
sdks/go/examples/wordcount/wordcount.go | 92 ++--
sdks/go/pkg/beam/artifact/materialize_test.go | 5 +-
sdks/go/pkg/beam/artifact/stage.go | 3 +-
sdks/go/pkg/beam/artifact/stage_test.go | 4 +-
.../pkg/beam/core/runtime/harness/datamgr_test.go | 5 +-
.../pkg/beam/core/runtime/harness/statemgr_test.go | 3 +-
.../runtime/xlangx/expansionx/download_test.go | 7 +-
sdks/go/pkg/beam/core/util/symtab/symtab_test.go | 3 +-
sdks/go/pkg/beam/io/avroio/avroio_test.go | 3 +-
sdks/go/pkg/beam/io/fhirio/import_test.go | 5 +-
sdks/go/pkg/beam/io/filesystem/memfs/memory.go | 3 +-
sdks/go/pkg/beam/io/filesystem/util.go | 3 +-
sdks/go/pkg/beam/io/parquetio/parquetio.go | 4 +-
sdks/go/pkg/beam/options/gcpopts/options_test.go | 3 +-
sdks/go/pkg/beam/runners/dot/dot.go | 4 +-
sdks/go/pkg/beam/util/gcsx/gcs.go | 3 +-
sdks/go/test/load/util.go | 4 +-
.../go/test/regression/coders/fromyaml/fromyaml.go | 4 +-
.../regression/coders/fromyaml/fromyaml_test.go | 4 +-
.../apache/beam/sdk/schemas/utils/JsonUtils.java | 103 ++++
.../beam/sdk/schemas/utils/JsonUtilsTest.java | 308 +++++++++++
.../extensions/python/PythonExternalTransform.java | 3 +-
.../JdbcIOExceptionHandlingParameterizedTest.java | 9 +
.../inference/pytorch_language_modeling.py | 44 +-
.../apache_beam/ml/inference/pytorch_inference.py | 23 +-
.../ml/inference/pytorch_inference_test.py | 69 ++-
.../apache_beam/ml/inference/sklearn_inference.py | 27 +-
.../ml/inference/sklearn_inference_test.py | 80 +++
.../runners/portability/expansion_service_main.py | 5 +
.../runners/portability/local_job_service_main.py | 5 -
sdks/typescript/test/io_test.ts | 22 +-
69 files changed, 1843 insertions(+), 247 deletions(-)
create mode 100644 .github/workflows/tour_of_beam_backend_integration.yml
create mode 100644 examples/notebooks/beam-ml/run_custom_inference.ipynb
copy learning/tour-of-beam/backend/{internal/entity.go => integration_tests/api.go} (59%)
create mode 100644 learning/tour-of-beam/backend/integration_tests/client.go
create mode 100644 learning/tour-of-beam/backend/integration_tests/function_test.go
create mode 100644 learning/tour-of-beam/backend/integration_tests/local.sh
delete mode 100644 learning/tour-of-beam/backend/internal/storage/image/index.yaml
create mode 100644 learning/tour-of-beam/backend/internal/storage/index.yaml
create mode 100644 learning/tour-of-beam/backend/samples/api/get_unit_content_full.json
create mode 100644 sdks/java/core/src/main/java/org/apache/beam/sdk/schemas/utils/JsonUtils.java
create mode 100644 sdks/java/core/src/test/java/org/apache/beam/sdk/schemas/utils/JsonUtilsTest.java