You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by gi...@apache.org on 2024/04/12 03:50:33 UTC

(beam) branch nightly-refs/heads/master updated (c1761abc512 -> e33dec69c7c)

This is an automated email from the ASF dual-hosted git repository.

github-bot pushed a change to branch nightly-refs/heads/master
in repository https://gitbox.apache.org/repos/asf/beam.git


    from c1761abc512 Adding support for high priority queries to xlang transforms writing … (#30869)
     add 48d80128f62 [yaml] add use-case example (#30896)
     add 8ca15eff0cf  Load and Stress Tests: Add workflows, improvements and fixes (#30848)
     add cc719214e44 [yaml] Add Beam YAML Blog (#30898)
     add f021bb08991 Fix cron in github workflow file (#30929)
     add ec5155ed26b Fix playground typo breaking rendering (#30930)
     add 701670624b3 Remove comma that breaks formatting (#30931)
     add 1dc3346705a Add gradle target and github workflow for cross-langauge yaml tests. (#30874)
     add 0e7b047c636 [yaml] Fix Beam YAML blog links (#30932)
     add 153c7db71d5 Fixup iceberg GitHub Action workflow
     add 983f4e8a499 Merge pull request #30935: Fixup iceberg GitHub Action workflow
     add 067ab8d70d6 Bump transformers from 4.36.0 to 4.38.0 in /sdks/python/apache_beam/examples/inference/runinference_metrics (#30924)
     add e1a3eafb6fe Add PubSubIO Stress test (#30886)
     add a6903628e77 Update sqlalchemy requirement from >=1.3,<2.0 to >=1.3,<3.0 in /sdks/python (#30919)
     add 67b3e111ea9 Upgrade grpcio-tools. (#30912)
     add e33dec69c7c Add config validation to kafka read schema transform (#30625)

No new revisions were added by this update.

Summary of changes:
 ...les_Direct.json => beam_PostCommit_Python.json} |   0
 .github/workflows/IO_Iceberg.yml                   |   5 +-
 ...ceberg.yml => beam_LoadTests_Java_PubsubIO.yml} |  79 ++------
 ...rg.yml => beam_PreCommit_Yaml_Xlang_Direct.yml} |  80 ++++----
 ...rg.yml => beam_StressTests_Java_BigQueryIO.yml} |  79 ++------
 ...rg.yml => beam_StressTests_Java_BigTableIO.yml} |  79 ++------
 .../workflows/beam_StressTests_Java_KafkaIO.yml    | 106 +++++++++++
 ...berg.yml => beam_StressTests_Java_PubSubIO.yml} |  79 ++------
 ...erg.yml => beam_StressTests_Java_SpannerIO.yml} |  79 ++------
 .../get-started/try-apache-beam-yaml.ipynb         |   2 +-
 it/google-cloud-platform/build.gradle              |  85 +++++++--
 .../org/apache/beam/it/gcp/IOLoadTestBase.java     |  14 +-
 .../java/org/apache/beam/it/gcp/LoadTestBase.java  |  32 ++--
 .../apache/beam/it/gcp/bigquery/BigQueryIOST.java  | 144 +++++----------
 .../apache/beam/it/gcp/bigtable/BigTableIOST.java  |  20 +-
 .../pubsub/{PubSubIOLT.java => PubSubIOST.java}    | 182 ++++++++++--------
 .../pubsub/{PubSubIOLT.java => PubsubIOLT.java}    | 144 +++++++--------
 .../apache/beam/it/gcp/spanner/SpannerIOST.java    |   6 +-
 it/kafka/build.gradle                              |  12 +-
 .../java/org/apache/beam/it/kafka/KafkaIOST.java   |  25 ++-
 playground/infrastructure/requirements.txt         |   2 +-
 .../KafkaReadSchemaTransformConfiguration.java     |  36 ++--
 .../io/kafka/KafkaReadSchemaTransformProvider.java |   2 +
 .../KafkaReadSchemaTransformProviderTest.java      |   4 +-
 .../inference/runinference_metrics/setup.py        |   2 +-
 .../io/external/xlang_jdbcio_it_test.py            |  16 +-
 .../apache_beam/yaml/examples/simple_filter.yaml   |  49 +++++
 .../yaml/examples/simple_filter_and_combine.yaml   |  64 +++++++
 .../yaml/examples/{ => testing}/__init__.py        |   0
 .../yaml/examples/{ => testing}/examples_test.py   |  82 +++++++--
 .../yaml/examples/wordcount_minimal.yaml           |   2 +-
 sdks/python/apache_beam/yaml/yaml_transform.py     |   4 +-
 sdks/python/build.gradle                           |  19 ++
 .../container/py310/base_image_requirements.txt    |   2 +-
 .../container/py311/base_image_requirements.txt    |   3 +-
 .../container/py38/base_image_requirements.txt     |   2 +-
 .../container/py39/base_image_requirements.txt     |   2 +-
 sdks/python/pyproject.toml                         |   2 +-
 sdks/python/setup.py                               |   2 +-
 .../www/site/content/en/blog/beam-yaml-release.md  | 205 +++++++++++++++++++++
 .../transforms/python/aggregation/distinct.md      |   2 +-
 website/www/site/data/authors.yml                  |   3 +
 42 files changed, 1070 insertions(+), 687 deletions(-)
 rename .github/trigger_files/{beam_PostCommit_Python_Examples_Direct.json => beam_PostCommit_Python.json} (100%)
 copy .github/workflows/{IO_Iceberg.yml => beam_LoadTests_Java_PubsubIO.yml} (51%)
 copy .github/workflows/{IO_Iceberg.yml => beam_PreCommit_Yaml_Xlang_Direct.yml} (65%)
 copy .github/workflows/{IO_Iceberg.yml => beam_StressTests_Java_BigQueryIO.yml} (51%)
 copy .github/workflows/{IO_Iceberg.yml => beam_StressTests_Java_BigTableIO.yml} (51%)
 create mode 100644 .github/workflows/beam_StressTests_Java_KafkaIO.yml
 copy .github/workflows/{IO_Iceberg.yml => beam_StressTests_Java_PubSubIO.yml} (51%)
 copy .github/workflows/{IO_Iceberg.yml => beam_StressTests_Java_SpannerIO.yml} (51%)
 copy it/google-cloud-platform/src/test/java/org/apache/beam/it/gcp/pubsub/{PubSubIOLT.java => PubSubIOST.java} (75%)
 rename it/google-cloud-platform/src/test/java/org/apache/beam/it/gcp/pubsub/{PubSubIOLT.java => PubsubIOLT.java} (82%)
 create mode 100644 sdks/python/apache_beam/yaml/examples/simple_filter.yaml
 create mode 100644 sdks/python/apache_beam/yaml/examples/simple_filter_and_combine.yaml
 rename sdks/python/apache_beam/yaml/examples/{ => testing}/__init__.py (100%)
 rename sdks/python/apache_beam/yaml/examples/{ => testing}/examples_test.py (63%)
 create mode 100644 website/www/site/content/en/blog/beam-yaml-release.md