You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by gi...@apache.org on 2025/09/10 03:55:50 UTC

(beam) branch nightly-refs/heads/master updated (fe188e3635b -> 9651c641240)

This is an automated email from the ASF dual-hosted git repository.

github-bot pushed a change to branch nightly-refs/heads/master
in repository https://gitbox.apache.org/repos/asf/beam.git


    from fe188e3635b [#34236] Add Vertex AI Multi-Modal embedding handler (#35677)
     add a2f9fb8e992 pin avro 1.12.0 in expansion service (#36092)
     add dffa53f7624 Correctly exclude prism when using external transforms (#36049)
     add 28ad2358097 Add interactive dependency to notebooks (#36091)
     add 10f0f072834 workflows: add `ALLOYDB_PASSWORD` to Precommit Python Transforms (#36096)
     add 6a4ce21a742 Use unsigned integer math to calculate progress in GrowableOffsetRangeTracker since the difference between two offsets does not exceed the maximum value of the unsigned representation.
     add 48b453a6b01 Merge pull request #35561: [GrowableOffsetRangeTracker] Use UnsignedLong instead of BigDecimal to calculate progress
     add 520b456b769 Only update size metrics once per batch
     add 60630afb39b Merge pull request #36077: [KafkaIO] Only update size metrics once per batch
     add 359c9ebec95 Introduce Schema Registry Functionality to Managed KafkaIO Write. (#35644)
     add 69aa8af121e Fix portableLocalRunnerJuliaSetWithSetupPy
     add 246d95587e7 Fix PostCommit Python job (#36098)
     add 9651c641240 Fix JDBC type validation to check for empty strings in Read and Write Postgres schema transform providers (#36103)

No new revisions were added by this update.

Summary of changes:
 .../beam_PostCommit_Python_Xlang_IO_Direct.json    |   2 +-
 .../workflows/beam_PreCommit_Python_Transforms.yml |   3 +-
 .../alloydb_product_catalog_embeddings.ipynb       |   2 +-
 .../anomaly_detection_iforest.ipynb                |   2 +-
 .../anomaly_detection_timesfm.ipynb                |   2 +-
 .../beam-ml/automatic_model_refresh.ipynb          |   2 +-
 .../bigquery_vector_ingestion_and_search.ipynb     |   2 +-
 ...cloudsql_mysql_product_catalog_embeddings.ipynb |   2 +-
 ...udsql_postgres_product_catalog_embeddings.ipynb |   2 +-
 .../compute_and_apply_vocab.ipynb                  |   2 +-
 .../huggingface_text_embeddings.ipynb              |   2 +-
 .../beam-ml/data_preprocessing/scale_data.ipynb    |   2 +-
 .../vertex_ai_text_embeddings.ipynb                |   2 +-
 .../gemma_2_sentiment_and_summarization.ipynb      |   4 +-
 .../beam-ml/image_processing_tensorflow.ipynb      |   3 +-
 examples/notebooks/beam-ml/mltransform_basic.ipynb |   2 +-
 examples/notebooks/beam-ml/per_key_models.ipynb    |   2 +-
 .../beam-ml/rag_usecase/beam_rag_notebook.ipynb    |   2 +-
 .../rag_usecase/opensearch_rag_pipeline.ipynb      |   2 +-
 .../notebooks/beam-ml/run_inference_gemma.ipynb    |   2 +-
 .../beam-ml/run_inference_generative_ai.ipynb      |   2 +-
 .../beam-ml/run_inference_multi_model.ipynb        |   2 +-
 .../notebooks/beam-ml/run_inference_pytorch.ipynb  |   2 +-
 .../run_inference_pytorch_tensorflow_sklearn.ipynb |   6 +-
 .../beam-ml/run_inference_tensorflow.ipynb         |   2 +-
 .../run_inference_tensorflow_with_tfx.ipynb        |   2 +-
 .../beam-ml/run_inference_vertex_ai.ipynb          |   2 +-
 .../run_inference_with_tensorflow_hub.ipynb        |   2 +-
 .../beam-ml/speech_emotion_tensorflow.ipynb        |   2 +-
 examples/notebooks/blog/unittests_in_beam.ipynb    |   2 +-
 .../splittabledofn/GrowableOffsetRangeTracker.java |  28 +----
 sdks/java/io/expansion-service/build.gradle        |   5 +-
 .../ReadFromPostgresSchemaTransformProvider.java   |   2 +-
 .../WriteToPostgresSchemaTransformProvider.java    |   2 +-
 sdks/java/io/kafka/build.gradle                    |   3 +
 sdks/java/io/kafka/kafka-integration-test.gradle   |   1 +
 .../org/apache/beam/sdk/io/kafka/KafkaIOUtils.java |  19 +--
 .../kafka/KafkaWriteSchemaTransformProvider.java   | 132 +++++++++++++++------
 .../beam/sdk/io/kafka/ReadFromKafkaDoFn.java       | 107 +++++++++--------
 .../KafkaWriteSchemaTransformProviderTest.java     |  44 ++++++-
 .../apache_beam/runners/direct/direct_runner.py    |  14 ++-
 sdks/python/test-suites/portable/common.gradle     |   2 +-
 42 files changed, 271 insertions(+), 156 deletions(-)