You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by gi...@apache.org on 2024/04/12 03:50:33 UTC
(beam) branch nightly-refs/heads/master updated (c1761abc512 -> e33dec69c7c)
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a change to branch nightly-refs/heads/master
in repository https://gitbox.apache.org/repos/asf/beam.git
from c1761abc512 Adding support for high priority queries to xlang transforms writing … (#30869)
add 48d80128f62 [yaml] add use-case example (#30896)
add 8ca15eff0cf Load and Stress Tests: Add workflows, improvements and fixes (#30848)
add cc719214e44 [yaml] Add Beam YAML Blog (#30898)
add f021bb08991 Fix cron in github workflow file (#30929)
add ec5155ed26b Fix playground typo breaking rendering (#30930)
add 701670624b3 Remove comma that breaks formatting (#30931)
add 1dc3346705a Add gradle target and github workflow for cross-langauge yaml tests. (#30874)
add 0e7b047c636 [yaml] Fix Beam YAML blog links (#30932)
add 153c7db71d5 Fixup iceberg GitHub Action workflow
add 983f4e8a499 Merge pull request #30935: Fixup iceberg GitHub Action workflow
add 067ab8d70d6 Bump transformers from 4.36.0 to 4.38.0 in /sdks/python/apache_beam/examples/inference/runinference_metrics (#30924)
add e1a3eafb6fe Add PubSubIO Stress test (#30886)
add a6903628e77 Update sqlalchemy requirement from >=1.3,<2.0 to >=1.3,<3.0 in /sdks/python (#30919)
add 67b3e111ea9 Upgrade grpcio-tools. (#30912)
add e33dec69c7c Add config validation to kafka read schema transform (#30625)
No new revisions were added by this update.
Summary of changes:
...les_Direct.json => beam_PostCommit_Python.json} | 0
.github/workflows/IO_Iceberg.yml | 5 +-
...ceberg.yml => beam_LoadTests_Java_PubsubIO.yml} | 79 ++------
...rg.yml => beam_PreCommit_Yaml_Xlang_Direct.yml} | 80 ++++----
...rg.yml => beam_StressTests_Java_BigQueryIO.yml} | 79 ++------
...rg.yml => beam_StressTests_Java_BigTableIO.yml} | 79 ++------
.../workflows/beam_StressTests_Java_KafkaIO.yml | 106 +++++++++++
...berg.yml => beam_StressTests_Java_PubSubIO.yml} | 79 ++------
...erg.yml => beam_StressTests_Java_SpannerIO.yml} | 79 ++------
.../get-started/try-apache-beam-yaml.ipynb | 2 +-
it/google-cloud-platform/build.gradle | 85 +++++++--
.../org/apache/beam/it/gcp/IOLoadTestBase.java | 14 +-
.../java/org/apache/beam/it/gcp/LoadTestBase.java | 32 ++--
.../apache/beam/it/gcp/bigquery/BigQueryIOST.java | 144 +++++----------
.../apache/beam/it/gcp/bigtable/BigTableIOST.java | 20 +-
.../pubsub/{PubSubIOLT.java => PubSubIOST.java} | 182 ++++++++++--------
.../pubsub/{PubSubIOLT.java => PubsubIOLT.java} | 144 +++++++--------
.../apache/beam/it/gcp/spanner/SpannerIOST.java | 6 +-
it/kafka/build.gradle | 12 +-
.../java/org/apache/beam/it/kafka/KafkaIOST.java | 25 ++-
playground/infrastructure/requirements.txt | 2 +-
.../KafkaReadSchemaTransformConfiguration.java | 36 ++--
.../io/kafka/KafkaReadSchemaTransformProvider.java | 2 +
.../KafkaReadSchemaTransformProviderTest.java | 4 +-
.../inference/runinference_metrics/setup.py | 2 +-
.../io/external/xlang_jdbcio_it_test.py | 16 +-
.../apache_beam/yaml/examples/simple_filter.yaml | 49 +++++
.../yaml/examples/simple_filter_and_combine.yaml | 64 +++++++
.../yaml/examples/{ => testing}/__init__.py | 0
.../yaml/examples/{ => testing}/examples_test.py | 82 +++++++--
.../yaml/examples/wordcount_minimal.yaml | 2 +-
sdks/python/apache_beam/yaml/yaml_transform.py | 4 +-
sdks/python/build.gradle | 19 ++
.../container/py310/base_image_requirements.txt | 2 +-
.../container/py311/base_image_requirements.txt | 3 +-
.../container/py38/base_image_requirements.txt | 2 +-
.../container/py39/base_image_requirements.txt | 2 +-
sdks/python/pyproject.toml | 2 +-
sdks/python/setup.py | 2 +-
.../www/site/content/en/blog/beam-yaml-release.md | 205 +++++++++++++++++++++
.../transforms/python/aggregation/distinct.md | 2 +-
website/www/site/data/authors.yml | 3 +
42 files changed, 1070 insertions(+), 687 deletions(-)
rename .github/trigger_files/{beam_PostCommit_Python_Examples_Direct.json => beam_PostCommit_Python.json} (100%)
copy .github/workflows/{IO_Iceberg.yml => beam_LoadTests_Java_PubsubIO.yml} (51%)
copy .github/workflows/{IO_Iceberg.yml => beam_PreCommit_Yaml_Xlang_Direct.yml} (65%)
copy .github/workflows/{IO_Iceberg.yml => beam_StressTests_Java_BigQueryIO.yml} (51%)
copy .github/workflows/{IO_Iceberg.yml => beam_StressTests_Java_BigTableIO.yml} (51%)
create mode 100644 .github/workflows/beam_StressTests_Java_KafkaIO.yml
copy .github/workflows/{IO_Iceberg.yml => beam_StressTests_Java_PubSubIO.yml} (51%)
copy .github/workflows/{IO_Iceberg.yml => beam_StressTests_Java_SpannerIO.yml} (51%)
copy it/google-cloud-platform/src/test/java/org/apache/beam/it/gcp/pubsub/{PubSubIOLT.java => PubSubIOST.java} (75%)
rename it/google-cloud-platform/src/test/java/org/apache/beam/it/gcp/pubsub/{PubSubIOLT.java => PubsubIOLT.java} (82%)
create mode 100644 sdks/python/apache_beam/yaml/examples/simple_filter.yaml
create mode 100644 sdks/python/apache_beam/yaml/examples/simple_filter_and_combine.yaml
rename sdks/python/apache_beam/yaml/examples/{ => testing}/__init__.py (100%)
rename sdks/python/apache_beam/yaml/examples/{ => testing}/examples_test.py (63%)
create mode 100644 website/www/site/content/en/blog/beam-yaml-release.md