You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by gi...@apache.org on 2024/05/02 03:45:50 UTC
(beam) branch nightly-refs/heads/master updated (43bf99ddcef -> a2987006ded)
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a change to branch nightly-refs/heads/master
in repository https://gitbox.apache.org/repos/asf/beam.git
from 43bf99ddcef Update game_stats.py (#31134)
add 557ad39882e Add `.python-version` to .gitignore (#31135)
add ea4770bf59c Add controlling multiple models across processes to CHANGES (#31147)
add f498cdfc2a8 Revert "Add Redistribute transform to Java SDK"
add 3b272d2c6c9 Revert "Add direct Dataflow translation of Redistribute transform"
add ece456c1a91 Revert "Add Redistribute translation to Spark runner"
add ab9af72aeed Revert "Add Redistribute translation to Samza runner"
add 49056fd7ed1 Revert "Add Redistribute translation to FlinkRunner"
add 8ef90be1b60 Merge pull request #31140: Revert addition of Redistribute and tests to Java SDK, and translations from runners
add 4458b8bb9bc Fix spotbug warning in KafkaIO PreCommit (#31146)
add 44e2abea788 Pin tensorflow version in notebook (#31145)
add dc5841d0ed0 [YAML] Increase re-use of providers with implicitly overlapping transforms. (#30793)
add d2db322c081 Fix ISM-expecting tests by explicilty requisting random access. (#31149)
add 670e56fb1b4 FnAPI proto changes for ordered list state. (#31092)
add a2987006ded update Changes.md for bigquery metrics (#31155)
No new revisions were added by this update.
Summary of changes:
.gitignore | 5 +-
CHANGES.md | 2 +
.../beam-ml/automatic_model_refresh.ipynb | 4 +-
.../beam/model/fn_execution/v1/beam_fn_api.proto | 37 ++
runners/flink/flink_runner.gradle | 1 -
runners/flink/job-server/flink_job_server.gradle | 2 -
.../FlinkBatchPortablePipelineTranslator.java | 17 +-
.../flink/FlinkBatchTransformTranslators.java | 78 ----
.../FlinkStreamingPortablePipelineTranslator.java | 22 --
.../flink/FlinkStreamingTransformTranslators.java | 37 --
.../dataflow/DataflowPipelineTranslator.java | 37 --
.../beam/runners/dataflow/util/PropertyNames.java | 1 -
.../dataflow/DataflowPipelineTranslatorTest.java | 4 +-
.../dataflow/worker/IsmSideInputReaderTest.java | 6 +-
.../translation/RedistributeByKeyTranslator.java | 64 ----
.../samza/translation/ReshuffleTranslator.java | 14 +-
.../samza/translation/SamzaPipelineTranslator.java | 1 -
.../spark/translation/TransformTranslator.java | 66 ----
.../streaming/StreamingTransformTranslator.java | 70 ----
.../apache/beam/sdk/transforms/Redistribute.java | 300 ---------------
.../util/construction/PTransformTranslation.java | 8 -
.../beam/sdk/transforms/RedistributeTest.java | 410 ---------------------
.../KafkaIOReadImplementationCompatibility.java | 24 +-
...KafkaIOReadImplementationCompatibilityTest.java | 2 +-
sdks/python/apache_beam/yaml/yaml_provider.py | 61 ++-
sdks/python/apache_beam/yaml/yaml_provider_test.py | 120 ++++++
sdks/python/apache_beam/yaml/yaml_transform.py | 50 ++-
.../apache_beam/yaml/yaml_transform_scope_test.py | 2 +-
.../apache_beam/yaml/yaml_transform_unit_test.py | 3 +-
29 files changed, 293 insertions(+), 1155 deletions(-)
delete mode 100644 runners/samza/src/main/java/org/apache/beam/runners/samza/translation/RedistributeByKeyTranslator.java
delete mode 100644 sdks/java/core/src/main/java/org/apache/beam/sdk/transforms/Redistribute.java
delete mode 100644 sdks/java/core/src/test/java/org/apache/beam/sdk/transforms/RedistributeTest.java
create mode 100644 sdks/python/apache_beam/yaml/yaml_provider_test.py