You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by gi...@apache.org on 2025/10/22 04:09:31 UTC
(beam) branch nightly-refs/heads/master updated (af748d07a1a -> db92a3ad0c0)
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a change to branch nightly-refs/heads/master
in repository https://gitbox.apache.org/repos/asf/beam.git
from af748d07a1a Update Python Dependencies (#36560)
add 1bf56295bc9 Fix publishing of ml/distroless images (#36548)
add 07b321e5811 Fix unsafe container cleanup that could delete images from other runs (#36547)
add e081879a78f Fix BigQueryIO File load validate runtime value provider (#36564)
add ee48e713282 [3/3] sdks/python: enrich data with Milvus Search [Vector, Keyword, Hybrid] (#35467)
add f8901e3a4c5 Update the release notes. (#36566)
add 15e8f98fed6 Fix dependency version (#36568)
add d0d0cd8c2f1 Revert "Add GRPC experiments to Python dockerfile (#36525)" (#36572)
add 944eef91344 Upload beam blog. (#36499)
add c22665c5111 Call now() once so start and end have exactly the same base timestamp. (#36574)
add 0d52be60e88 Add image generation code to Gemini Model Handler (#36177)
add 179d4d1ee9c Fix flaky tests (#36579)
add 7e7d866d95a [python] add setup to BigQuery's convert row Map transform (#36502)
add c7d920f26cf Update dev image. (#36582)
add 243d4077319 Integrate lambda name pickling with Cloudpickle (#35904)
add ab892e3dd09 Add logging for credential retrieval failures in GcpCredentialFactory
add db92a3ad0c0 Merge pull request #36415: Add logging for credential retrieval failures in GcpCredentialFactory
No new revisions were added by this update.
Summary of changes:
.../workflows/beam_Publish_Beam_SDK_Snapshots.yml | 5 +
.github/workflows/build_release_candidate.yml | 18 +-
.../republish_released_docker_containers.yml | 18 +-
CHANGES.md | 10 +-
.../beam-ml/milvus_enrichment_transform.ipynb | 2657 ++++++++++++++++++++
.../extensions/gcp/auth/GcpCredentialFactory.java | 5 +
.../beam/sdk/io/gcp/bigquery/BatchLoads.java | 7 +-
.../sdk/io/gcp/bigquery/BigQueryIOWriteTest.java | 2 +
...lassification.py => gemini_image_generation.py} | 49 +-
.../inference/gemini_text_classification.py | 12 +-
.../snippets/transforms/elementwise/enrichment.py | 77 +-
.../transforms/elementwise/enrichment_test.py | 171 +-
.../internal/cloudpickle/cloudpickle.py | 78 +
.../apache_beam/internal/cloudpickle_pickler.py | 17 +-
.../apache_beam/internal/code_object_pickler.py | 90 +-
.../internal/code_object_pickler_test.py | 27 +-
sdks/python/apache_beam/internal/module_test.py | 7 +
sdks/python/apache_beam/internal/pickler.py | 14 +-
sdks/python/apache_beam/internal/pickler_test.py | 44 +
sdks/python/apache_beam/io/filebasedsink.py | 14 +
sdks/python/apache_beam/io/gcp/bigquery.py | 34 +-
.../apache_beam/ml/inference/gemini_inference.py | 42 +-
.../ml/inference/gemini_inference_it_test.py | 25 +
.../ml/inference/gemini_tests_requirements.txt | 3 +-
.../apache_beam/ml/rag/enrichment/milvus_search.py | 49 +-
.../ml/rag/enrichment/milvus_search_it_test.py | 27 +-
.../apache_beam/runners/dataflow/internal/names.py | 2 +-
.../python/apache_beam/runners/pipeline_context.py | 1 +
.../python/apache_beam/transforms/external_test.py | 22 +-
.../apache_beam/transforms/periodicsequence.py | 3 +-
sdks/python/apache_beam/transforms/ptransform.py | 2 +
sdks/python/container/Dockerfile | 5 -
sdks/python/container/build.gradle | 8 +-
sdks/python/container/ml/common.gradle | 2 +-
sdks/python/container/run_validatescontainer.sh | 16 +-
.../en/blog/gsoc-25-jupyterlab-extensions.md | 74 +
.../python/elementwise/enrichment-cloudsql.md | 4 +-
.../python/elementwise/enrichment-milvus.md | 65 +
.../transforms/python/elementwise/enrichment.md | 3 +-
website/www/site/data/authors.yml | 3 +
.../partials/section-menu/en/documentation.html | 1 +
.../gsoc-25-jupyterlab-extensions/Yaml_main.png | Bin 0 -> 305413 bytes
42 files changed, 3537 insertions(+), 176 deletions(-)
create mode 100644 examples/notebooks/beam-ml/milvus_enrichment_transform.ipynb
copy sdks/python/apache_beam/examples/inference/{gemini_text_classification.py => gemini_image_generation.py} (72%)
create mode 100644 website/www/site/content/en/blog/gsoc-25-jupyterlab-extensions.md
create mode 100644 website/www/site/content/en/documentation/transforms/python/elementwise/enrichment-milvus.md
create mode 100644 website/www/site/static/images/blog/gsoc-25-jupyterlab-extensions/Yaml_main.png