[beam] branch nightly-refs/heads/master updated (aa9b2aa -> ec62f3d)

[gi...@apache.org]

This is an automated email from the ASF dual-hosted git repository.

github-bot pushed a change to branch nightly-refs/heads/master
in repository https://gitbox.apache.org/repos/asf/beam.git.


    from aa9b2aa  Merge pull request #17195 [BEAM-14163] Fix typo in single core per container logic.
     add 050e12a  feat: remove the metadata table after the pipeline finishes
     add 1cc6884  test: add test for metadata table dropping
     add 3513b38  Merge branch 'master' of github.com:hengfengli/beam into remove-metadata-table
     add 8d9880f  test: disable SpannerIO.readChangeStream test
     add 48557d0  Merge pull request #17182 from [BEAM-14185]: remove the metadata table after the pipeline finishes for Spanner Change Streams Connector
     add 71e6715  Merge pull request #17164 from [BEAM-14140][Playground] Fix Deploy examples CI to run only on changed examples
     add bf28986  Merge pull request #16855 from [BEAM-13938][Playground] Increase test coverage for the graphs
     add c353a96  Convert URLs to local jars when constructing filesToStage
     add dc5e209  Merge pull request #17199: [BEAM-14191] Convert URLs to local jars when constructing filesToStage
     add c84818d  [BEAM-13314]Revise recommendations to manage Python pipeline dependencies. (#16938)
     add a090e90  Merge pull request #17202 from [BEAM-14194]: Disallow autoscaling for SpannerIO.readChangeStream
     add c4ef079  Merge pull request #17080 from [BEAM-13880] [Playground] Increase test coverage for the setup_tools package
     add 770954a  Merge pull request #17050 from [BEAM-13877] [Playground] Increase test coverage for the executors package
     add e267fd7  Update display data to include BQ information.
     add 6d1fe2e  Merge pull request #17098 from [BEAM-10917] Update display data in BigQuery Read API Source.
     add 1d2a0fe  [BEAM-14200] Improve SamzaJobInvoker extensibility (#17212)
     add 1bba8a3  Merge pull request #17148 from [BEAM-14042] [playground] Scroll imports and licence on the embedded version
     add 4c90af8  [BEAM-13918] Increase datastoreio go sdk unit test coverage (#17173)
     add 531406c  Ensure the removed option prebuild_sdk_container_base_image not used on its own.
     add 407a96f  Disallow the removed option prebuild_sdk_container_base_image. #17204
     add 2588694  Merge pull request #16819: [BEAM-13806] Adding test suite for Go x-lang tests on Dataflow.
     add 618bdf2  Revert "[BEAM-14084] iterable_input_value_types changed from list to iterable"
     add ec62f3d  Merge pull request #17194 from apache/revert-17066-fixTodoUp

No new revisions were added by this update.

Summary of changes:
 .github/workflows/playground_deploy_examples.yml   |  45 ++-
 ...ageValidatesRunner_GoUsingJava_Dataflow.groovy} |  12 +-
 .../internal/executors/executor_builder_test.go    | 249 ++++++++++++
 .../backend/internal/executors/executor_test.go    | 173 +++++++++
 .../internal/preparers/go_preparers_test.go        |   6 +-
 .../backend/internal/preparers/java_preparers.go   |   5 +-
 .../internal/preparers/java_preparers_test.go      |   6 +-
 .../internal/preparers/python_preparers_test.go    |   6 +-
 .../internal/preparers/scio_preparers_test.go      |   2 +-
 .../setup_tools/builder/setup_builder_test.go      | 416 ++++++++++++++++++---
 .../setup_tools/life_cycle/life_cycle_setuper.go   |  13 +-
 .../life_cycle/life_cycle_setuper_test.go          | 228 ++++++++++-
 playground/frontend/lib/constants/params.dart      |   1 +
 .../modules/editor/components/editor_textarea.dart |   3 -
 .../lib/modules/examples/models/example_model.dart |   6 +-
 .../example_client/example_client.dart             |  10 +-
 .../example_client/grpc_example_client.dart        |  26 +-
 .../examples/repositories/example_repository.dart  |   9 +-
 .../models/get_default_example_response.dart       |  25 --
 ...esponse.dart => get_example_code_response.dart} |   4 +-
 .../repositories/models/get_example_response.dart  |   6 +-
 .../components/embedded_editor.dart                |   1 -
 .../embedded_page_providers.dart                   |   9 +-
 .../pages/playground/states/examples_state.dart    |   6 +
 playground/frontend/pubspec.lock                   | 129 ++++---
 .../states/example_selector_state_test.mocks.dart  |  79 ++--
 playground/infrastructure/checker.py               |  62 +++
 runners/google-cloud-dataflow-java/build.gradle    |   4 +-
 .../dataflow/DataflowPipelineTranslator.java       |  27 ++
 .../dataflow/DataflowPipelineTranslatorTest.java   |  67 ++++
 .../apache/beam/runners/samza/SamzaJobInvoker.java |   6 +-
 sdks/go/pkg/beam/io/datastoreio/datastore.go       |  54 ++-
 sdks/go/pkg/beam/io/datastoreio/datastore_test.go  | 143 ++++++-
 .../apache/beam/sdk/io/gcp/spanner/SpannerIO.java  |  21 +-
 .../dofn/CleanUpReadChangeStreamDoFn.java}         |  20 +-
 .../changestreams/it/IntegrationTestEnv.java       |  18 +-
 .../changestreams/it/SpannerChangeStreamIT.java    |  44 ++-
 ...nnerChangeStreamOrderedWithinKeyGloballyIT.java |   2 +
 .../it/SpannerChangeStreamOrderedWithinKeyIT.java  |   2 +
 sdks/python/apache_beam/io/gcp/bigquery.py         |   4 +-
 .../python/apache_beam/options/pipeline_options.py |   9 +
 .../options/pipeline_options_validator.py          |  12 +
 .../options/pipeline_options_validator_test.py     |  25 ++
 sdks/python/apache_beam/transforms/external.py     |   7 +-
 .../python/apache_beam/transforms/external_test.py |  62 ++-
 sdks/python/apache_beam/transforms/util.py         |   3 +-
 .../en/documentation/runtime/environments.md       |  46 ++-
 .../sdks/python-pipeline-dependencies.md           |  38 +-
 48 files changed, 1850 insertions(+), 301 deletions(-)
 copy .test-infra/jenkins/{job_PostCommit_Java_ValidatesRunner_Samza.groovy => job_PostCommit_CrossLanguageValidatesRunner_GoUsingJava_Dataflow.groovy} (73%)
 create mode 100644 playground/backend/internal/executors/executor_builder_test.go
 delete mode 100644 playground/frontend/lib/modules/examples/repositories/models/get_default_example_response.dart
 copy playground/frontend/lib/modules/examples/repositories/models/{get_example_response.dart => get_example_code_response.dart} (92%)
 create mode 100644 playground/infrastructure/checker.py
 copy sdks/java/{extensions/sql/src/main/java/org/apache/beam/sdk/extensions/sql/impl/transform/BeamSqlOutputToConsoleFn.java => io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/spanner/changestreams/dofn/CleanUpReadChangeStreamDoFn.java} (59%)