You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by gi...@apache.org on 2023/07/07 05:15:21 UTC
[beam] branch nightly-refs/heads/master updated (79fcfc6fcb5 -> f19c384af1f)
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a change to branch nightly-refs/heads/master
in repository https://gitbox.apache.org/repos/asf/beam.git
from 79fcfc6fcb5 Fix flakiness for BeamFnLoggingClientTest (#27308)
add 5bc80aa2e6d Inherit Generic for TimestampedValue (#26290)
add c28fa0639c2 Update 2.50 release notes to include new Kafka topicPattern feature (#27367)
add a6760153543 Bump golang.org/x/oauth2 from 0.9.0 to 0.10.0 in /sdks (#27376)
add cafb3da0523 Bump @grpc/grpc-js from 1.6.7 to 1.8.8 in /sdks/typescript (#27372)
add 556d93365a1 Update dataflow container versions (#27381)
add 44f165fedf6 Update python options in runners/spark.md. (#27334)
add a5873792a36 Fix mismatched section title in Release Guide (#27383)
add b529efecc9d MLTransform (#26795)
add 9e6420d9f90 Arc additional pools (#27369)
add 7eaef18bcbf Address failing BT read tests in #27319 (#27322)
add ccf6544a636 Automatically use Docker Compose based transform service for PythonExternalTransform when needed.
add f19c384af1f Merge pull request #27365: Automatically use Docker Compose based transform service for PythonExternalTransform when needed.
No new revisions were added by this update.
Summary of changes:
.../gh-actions-self-hosted-runners/arc/README.md | 44 ++-
.../arc/config/arc_autoscaler.tpl | 4 +-
.../arc/config/arc_deployment.tpl | 35 +-
.../arc/environments/beam.env | 42 +-
.github/gh-actions-self-hosted-runners/arc/gke.tf | 53 ++-
.github/gh-actions-self-hosted-runners/arc/helm.tf | 2 +-
.../arc/kubernetes.tf | 30 +-
.../arc/variables.tf | 87 ++--
CHANGES.md | 1 +
sdks/go.mod | 10 +-
sdks/go.sum | 20 +-
.../extensions/python/PythonExternalTransform.java | 58 ++-
.../BigtableReadSchemaTransformProviderIT.java | 42 +-
.../launcher/TransformServiceLauncher.java | 8 +-
.../examples/ml_transform/ml_transform_basic.py | 118 ++++++
.../python/apache_beam/ml/transforms}/__init__.py | 0
sdks/python/apache_beam/ml/transforms/base.py | 165 ++++++++
sdks/python/apache_beam/ml/transforms/base_test.py | 246 ++++++++++++
sdks/python/apache_beam/ml/transforms/handlers.py | 410 +++++++++++++++++++
.../apache_beam/ml/transforms/handlers_test.py | 355 +++++++++++++++++
sdks/python/apache_beam/ml/transforms/tft.py | 440 +++++++++++++++++++++
sdks/python/apache_beam/ml/transforms/tft_test.py | 395 ++++++++++++++++++
sdks/python/apache_beam/ml/transforms/utils.py | 56 +++
.../apache_beam/runners/dataflow/internal/names.py | 4 +-
sdks/python/apache_beam/transforms/core.py | 3 +-
.../transforms/timestamped_value_type_test.py | 139 +++++++
sdks/python/apache_beam/transforms/window.py | 9 +-
sdks/python/apache_beam/typehints/typecheck.py | 18 +-
sdks/python/scripts/generate_pydoc.sh | 2 +-
sdks/python/test-suites/tox/py38/build.gradle | 4 +
sdks/python/tox.ini | 6 +
sdks/typescript/package-lock.json | 349 +++++++++++++++-
sdks/typescript/package.json | 2 +-
.../site/content/en/contribute/release-guide.md | 2 +-
.../site/content/en/documentation/runners/spark.md | 2 +-
35 files changed, 3032 insertions(+), 129 deletions(-)
create mode 100644 sdks/python/apache_beam/examples/ml_transform/ml_transform_basic.py
copy {examples/notebooks/notebook_test_scripts => sdks/python/apache_beam/ml/transforms}/__init__.py (100%)
create mode 100644 sdks/python/apache_beam/ml/transforms/base.py
create mode 100644 sdks/python/apache_beam/ml/transforms/base_test.py
create mode 100644 sdks/python/apache_beam/ml/transforms/handlers.py
create mode 100644 sdks/python/apache_beam/ml/transforms/handlers_test.py
create mode 100644 sdks/python/apache_beam/ml/transforms/tft.py
create mode 100644 sdks/python/apache_beam/ml/transforms/tft_test.py
create mode 100644 sdks/python/apache_beam/ml/transforms/utils.py
create mode 100644 sdks/python/apache_beam/transforms/timestamped_value_type_test.py