You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by gi...@apache.org on 2024/05/14 03:50:23 UTC
(beam) branch nightly-refs/heads/master updated (66da760357c -> c88a863870c)
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a change to branch nightly-refs/heads/master
in repository https://gitbox.apache.org/repos/asf/beam.git
from 66da760357c Update yaml to non-beta link (#31210)
add a0c08272d42 Touch trigger files for all relevant ValidatesRunner and PVR suites
add bf347fe898b Sickbay extremely flaky Flink ParDoLifecycleTest
add ef431ec90f2 Reapply "Add Redistribute transform to Java SDK"
add 737be230347 Merge pull request #31156: Reapply "Add Redistribute transform to Java SDK"
add 466516b016c [Python] Use BufferedLogger instead of logger to log in boot.go (#31265)
add 749c128bef1 Disclaim direct runner result can be different with remote runners (#31250)
add c230655a1e5 Implement the hash_words TFT operation (#31249)
add 296c13a291d Avoid side input issue where Latest.globally produces 2 elements in a window (#31263)
add c88a863870c Add a subsuite of unit tests for ML package and remove them from 'coverage' GHA workflow. (#31255)
No new revisions were added by this update.
Summary of changes:
.../beam_PostCommit_Java_PVR_Flink_Batch.json | 4 +
.../beam_PostCommit_Java_PVR_Flink_Docker.json | 4 +
.../beam_PostCommit_Java_PVR_Flink_Streaming.json | 4 +
.../beam_PostCommit_Java_PVR_Samza.json | 4 +
.../beam_PostCommit_Java_PVR_Spark3_Batch.json | 4 +
.../beam_PostCommit_Java_PVR_Spark3_Streaming.json | 3 +-
...m_PostCommit_Java_ValidatesRunner_Dataflow.json | 3 +-
...Java_ValidatesRunner_Dataflow_JavaVersions.json | 4 +
...it_Java_ValidatesRunner_Dataflow_Streaming.json | 3 +-
...ostCommit_Java_ValidatesRunner_Dataflow_V2.json | 3 +-
...Java_ValidatesRunner_Dataflow_V2_Streaming.json | 3 +-
...eam_PostCommit_Java_ValidatesRunner_Direct.json | 4 +
...t_Java_ValidatesRunner_Direct_JavaVersions.json | 4 +
...beam_PostCommit_Java_ValidatesRunner_Flink.json | 3 +-
...stCommit_Java_ValidatesRunner_Flink_Java11.json | 3 +-
...beam_PostCommit_Java_ValidatesRunner_Samza.json | 3 +-
...beam_PostCommit_Java_ValidatesRunner_Spark.json | 3 +-
...a_ValidatesRunner_SparkStructuredStreaming.json | 3 +-
...stCommit_Java_ValidatesRunner_Spark_Java11.json | 4 +
...m_PostCommit_Java_ValidatesRunner_Twister2.json | 3 +-
.../beam_PostCommit_Java_ValidatesRunner_ULR.json | 3 +-
.github/workflows/README.md | 1 +
.github/workflows/beam_PreCommit_Python.yml | 3 +-
.../workflows/beam_PreCommit_Python_Dataframes.yml | 3 +-
.../workflows/beam_PreCommit_Python_Examples.yml | 3 +-
...on_Runners.yml => beam_PreCommit_Python_ML.yml} | 19 +-
.../workflows/beam_PreCommit_Python_Runners.yml | 3 +-
.../workflows/beam_PreCommit_Python_Transforms.yml | 3 +-
.../apache/beam/examples/snippets/Snippets.java | 14 +-
runners/flink/flink_runner.gradle | 3 +
runners/flink/job-server/flink_job_server.gradle | 2 +
runners/portability/java/build.gradle | 2 +
runners/samza/job-server/build.gradle | 2 +
runners/spark/job-server/spark_job_server.gradle | 8 +
runners/spark/spark_runner.gradle | 7 +
.../apache/beam/sdk/transforms/Redistribute.java | 300 +++++++++++++++
.../util/construction/PTransformTranslation.java | 8 +
.../beam/sdk/transforms/RedistributeTest.java | 410 +++++++++++++++++++++
.../ml/inference/huggingface_inference.py | 2 +-
.../ml/inference/huggingface_inference_test.py | 2 +-
.../ml/inference/onnx_inference_test.py | 4 +
sdks/python/apache_beam/ml/transforms/tft.py | 44 +++
sdks/python/apache_beam/ml/transforms/tft_test.py | 77 ++++
sdks/python/container/boot.go | 4 +-
sdks/python/setup.py | 19 +
sdks/python/test-suites/tox/common.gradle | 3 +
sdks/python/test-suites/tox/py38/build.gradle | 18 +-
sdks/python/test-suites/tox/pycommon/build.gradle | 4 +-
sdks/python/tox.ini | 8 +
.../content/en/documentation/runners/direct.md | 5 +
50 files changed, 1002 insertions(+), 51 deletions(-)
create mode 100644 .github/trigger_files/beam_PostCommit_Java_PVR_Flink_Batch.json
create mode 100644 .github/trigger_files/beam_PostCommit_Java_PVR_Flink_Docker.json
create mode 100644 .github/trigger_files/beam_PostCommit_Java_PVR_Flink_Streaming.json
create mode 100644 .github/trigger_files/beam_PostCommit_Java_PVR_Samza.json
create mode 100644 .github/trigger_files/beam_PostCommit_Java_PVR_Spark3_Batch.json
create mode 100644 .github/trigger_files/beam_PostCommit_Java_ValidatesRunner_Dataflow_JavaVersions.json
create mode 100644 .github/trigger_files/beam_PostCommit_Java_ValidatesRunner_Direct.json
create mode 100644 .github/trigger_files/beam_PostCommit_Java_ValidatesRunner_Direct_JavaVersions.json
create mode 100644 .github/trigger_files/beam_PostCommit_Java_ValidatesRunner_Spark_Java11.json
copy .github/workflows/{beam_PreCommit_Python_Runners.yml => beam_PreCommit_Python_ML.yml} (88%)
create mode 100644 sdks/java/core/src/main/java/org/apache/beam/sdk/transforms/Redistribute.java
create mode 100644 sdks/java/core/src/test/java/org/apache/beam/sdk/transforms/RedistributeTest.java