You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by gi...@apache.org on 2023/12/02 03:50:19 UTC

(beam) branch nightly-refs/heads/master updated (c6c70860400 -> 85d4fcf7f37)

This is an automated email from the ASF dual-hosted git repository.

github-bot pushed a change to branch nightly-refs/heads/master
in repository https://gitbox.apache.org/repos/asf/beam.git


    from c6c70860400 Enable triggering postcommit via specific file (#29549)
     add 35a0b68c06b Fix small doc issues (#29578)
     add 7c99c330350 Bump github.com/aws/aws-sdk-go-v2/credentials in /sdks (#29575)
     add 5f6afcef55f Bump cryptography from 41.0.4 to 41.0.6 in /sdks/python/container/py38 (#29554)
     add 90b1a6b7200 Add new AnyOf environment.
     add e5a9ab6233e Add AnyOf environment handling to the various runners.
     add b136f1d3dd6 Add AnyOf environment handling to the artifact staging services.
     add 6550cec0e9c Add the ability to cache subprocess services for the duration of a pipeline.
     add e8cebdf4fe7 Add an option to start loopback workers in expansion services.
     add e88fb5df887 Use Java expansion services as workers by default in Python.
     add d85ce3f38c5 More complete documentation of environment proto definitions.
     add f337c74b828 Merge pull request #29283 Cross language pipelines without Docker.
     add 26135b07473 Support for upgrading BigQuery transforms without upgrading the pipeline (#29550)
     add ebc4a5585e0 Documents the transform upgrade feature (#29581)
     add 39e1615f945 fix typos (#29588)
     add 04fe4b53433 Consider underlying providers in both directions when doing affinity test.
     add 85d4fcf7f37 Merge pull request #29586 from Better affinity test.

No new revisions were added by this update.

Summary of changes:
 CHANGES.md                                         |   5 +-
 .../beam/model/pipeline/v1/beam_runner_api.proto   |  34 +-
 .../runners/core/construction/Environments.java    |  47 ++
 .../core/construction/TransformUpgrader.java       |  52 +-
 .../core/construction/EnvironmentsTest.java        |  41 ++
 .../beam/runners/dataflow/DataflowRunner.java      |  16 +
 .../control/DefaultJobBundleFactory.java           |   6 +
 .../runners/jobsubmission/InMemoryJobService.java  |  58 +-
 sdks/go.mod                                        |  22 +-
 sdks/go.sum                                        |  44 +-
 sdks/java/expansion-service/build.gradle           |   3 +
 .../sdk/expansion/service/ExpansionService.java    |  55 +-
 .../expansion/service/ExpansionServiceOptions.java |   5 +
 .../sdk/io/gcp/bigquery/BigQueryIOTranslation.java | 782 +++++++++++++++++++++
 .../io/gcp/bigquery/BigQueryIOTranslationTest.java | 303 ++++++++
 .../sdk/io/kafka/upgrade/KafkaIOTranslation.java   |  26 +-
 sdks/python/apache_beam/io/gcp/bigquery.py         |  18 +-
 sdks/python/apache_beam/pipeline.py                |  10 +-
 .../runners/dataflow/dataflow_runner.py            |   8 +-
 .../runners/portability/expansion_service.py       |  14 +-
 .../runners/portability/expansion_service_main.py  |  16 +-
 .../runners/portability/fn_api_runner/fn_runner.py |  29 +-
 .../portability/fn_api_runner/worker_handlers.py   |  12 +
 .../runners/portability/local_job_service.py       |  59 +-
 sdks/python/apache_beam/transforms/environments.py |  58 ++
 sdks/python/apache_beam/transforms/external.py     |  27 +-
 sdks/python/apache_beam/utils/subprocess_server.py | 192 +++--
 .../apache_beam/utils/subprocess_server_test.py    |  79 +++
 sdks/python/apache_beam/yaml/yaml_provider.py      |   6 +-
 .../container/py38/base_image_requirements.txt     |   2 +-
 website/www/site/content/en/blog/beam-2.52.0.md    |  69 +-
 .../content/en/documentation/programming-guide.md  |  64 +-
 .../partials/section-menu/en/documentation.html    |   1 +
 33 files changed, 1949 insertions(+), 214 deletions(-)
 create mode 100644 sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/bigquery/BigQueryIOTranslation.java
 create mode 100644 sdks/java/io/google-cloud-platform/src/test/java/org/apache/beam/sdk/io/gcp/bigquery/BigQueryIOTranslationTest.java