You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by gi...@apache.org on 2025/10/22 04:09:31 UTC

(beam) branch nightly-refs/heads/master updated (af748d07a1a -> db92a3ad0c0)

This is an automated email from the ASF dual-hosted git repository.

github-bot pushed a change to branch nightly-refs/heads/master
in repository https://gitbox.apache.org/repos/asf/beam.git


    from af748d07a1a Update Python Dependencies (#36560)
     add 1bf56295bc9 Fix publishing of ml/distroless images (#36548)
     add 07b321e5811 Fix unsafe container cleanup that could delete images from other runs (#36547)
     add e081879a78f Fix BigQueryIO File load validate runtime value provider (#36564)
     add ee48e713282 [3/3] sdks/python: enrich data with Milvus Search [Vector, Keyword, Hybrid] (#35467)
     add f8901e3a4c5 Update the release notes. (#36566)
     add 15e8f98fed6 Fix dependency version (#36568)
     add d0d0cd8c2f1 Revert "Add GRPC experiments to Python dockerfile (#36525)" (#36572)
     add 944eef91344 Upload beam blog. (#36499)
     add c22665c5111 Call now() once so start and end have exactly the same base timestamp. (#36574)
     add 0d52be60e88 Add image generation code to Gemini Model Handler (#36177)
     add 179d4d1ee9c Fix flaky tests (#36579)
     add 7e7d866d95a [python] add setup to BigQuery's convert row Map transform (#36502)
     add c7d920f26cf Update dev image. (#36582)
     add 243d4077319 Integrate lambda name pickling with Cloudpickle (#35904)
     add ab892e3dd09 Add logging for credential retrieval failures in GcpCredentialFactory
     add db92a3ad0c0 Merge pull request #36415: Add logging for credential retrieval failures in GcpCredentialFactory

No new revisions were added by this update.

Summary of changes:
 .../workflows/beam_Publish_Beam_SDK_Snapshots.yml  |    5 +
 .github/workflows/build_release_candidate.yml      |   18 +-
 .../republish_released_docker_containers.yml       |   18 +-
 CHANGES.md                                         |   10 +-
 .../beam-ml/milvus_enrichment_transform.ipynb      | 2657 ++++++++++++++++++++
 .../extensions/gcp/auth/GcpCredentialFactory.java  |    5 +
 .../beam/sdk/io/gcp/bigquery/BatchLoads.java       |    7 +-
 .../sdk/io/gcp/bigquery/BigQueryIOWriteTest.java   |    2 +
 ...lassification.py => gemini_image_generation.py} |   49 +-
 .../inference/gemini_text_classification.py        |   12 +-
 .../snippets/transforms/elementwise/enrichment.py  |   77 +-
 .../transforms/elementwise/enrichment_test.py      |  171 +-
 .../internal/cloudpickle/cloudpickle.py            |   78 +
 .../apache_beam/internal/cloudpickle_pickler.py    |   17 +-
 .../apache_beam/internal/code_object_pickler.py    |   90 +-
 .../internal/code_object_pickler_test.py           |   27 +-
 sdks/python/apache_beam/internal/module_test.py    |    7 +
 sdks/python/apache_beam/internal/pickler.py        |   14 +-
 sdks/python/apache_beam/internal/pickler_test.py   |   44 +
 sdks/python/apache_beam/io/filebasedsink.py        |   14 +
 sdks/python/apache_beam/io/gcp/bigquery.py         |   34 +-
 .../apache_beam/ml/inference/gemini_inference.py   |   42 +-
 .../ml/inference/gemini_inference_it_test.py       |   25 +
 .../ml/inference/gemini_tests_requirements.txt     |    3 +-
 .../apache_beam/ml/rag/enrichment/milvus_search.py |   49 +-
 .../ml/rag/enrichment/milvus_search_it_test.py     |   27 +-
 .../apache_beam/runners/dataflow/internal/names.py |    2 +-
 .../python/apache_beam/runners/pipeline_context.py |    1 +
 .../python/apache_beam/transforms/external_test.py |   22 +-
 .../apache_beam/transforms/periodicsequence.py     |    3 +-
 sdks/python/apache_beam/transforms/ptransform.py   |    2 +
 sdks/python/container/Dockerfile                   |    5 -
 sdks/python/container/build.gradle                 |    8 +-
 sdks/python/container/ml/common.gradle             |    2 +-
 sdks/python/container/run_validatescontainer.sh    |   16 +-
 .../en/blog/gsoc-25-jupyterlab-extensions.md       |   74 +
 .../python/elementwise/enrichment-cloudsql.md      |    4 +-
 .../python/elementwise/enrichment-milvus.md        |   65 +
 .../transforms/python/elementwise/enrichment.md    |    3 +-
 website/www/site/data/authors.yml                  |    3 +
 .../partials/section-menu/en/documentation.html    |    1 +
 .../gsoc-25-jupyterlab-extensions/Yaml_main.png    |  Bin 0 -> 305413 bytes
 42 files changed, 3537 insertions(+), 176 deletions(-)
 create mode 100644 examples/notebooks/beam-ml/milvus_enrichment_transform.ipynb
 copy sdks/python/apache_beam/examples/inference/{gemini_text_classification.py => gemini_image_generation.py} (72%)
 create mode 100644 website/www/site/content/en/blog/gsoc-25-jupyterlab-extensions.md
 create mode 100644 website/www/site/content/en/documentation/transforms/python/elementwise/enrichment-milvus.md
 create mode 100644 website/www/site/static/images/blog/gsoc-25-jupyterlab-extensions/Yaml_main.png