You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by gi...@apache.org on 2022/02/15 04:03:16 UTC
[beam] branch nightly-refs/heads/master updated (c73066c -> 150e311)
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a change to branch nightly-refs/heads/master
in repository https://gitbox.apache.org/repos/asf/beam.git.
from c73066c Merge pull request #16661: [BEAM-9195] Bump org.testcontainers to 1.16.3
add 6e425f3 Merge pull request #16703 from [BEAM-13804][Playground][Bugfix] Add different constants to scala projects to run WordCount examples
add b9c6ce0 fix name project id from secreton scio deploy action
add b21bb9d Merge pull request #16790 from [BEAM-13862][Playground][Bugfix] Fix name of project Id for SCIO GHA
add 9f033e0 [BEAM-13775] Fixed bug with run button
add c29f1b5 Merge pull request #16821 from [BEAM-13775] [Playground] Run button after start of the processing and move output tab
add ee238ce Merge pull request #16611 from [BEAM-13712][Playground] Add graph for python
add 8944cb9 [BEAM-13836] Fix the answers placeholders locations in the Python katas
add 0148d30 Merge pull request #16820 from [BEAM-13836] Fix the answers placeholders locations in the Python katas
add 84353a7 Merge pull request #16757 from [BEAM-13655] [Playground] Persist the dark/light mode selection
add 1150fc6 Update 2.36.0 blog post to mention ARM64 support
add 89fa0aa Merge pull request #16839: Update 2.36.0 blog post to mention ARM64 support
add 911211f Minor: Disable checker framework in nightly snapshot (#16829)
add d2ad38a [BEAM-13860] Make `DoFn.infer_output_type` return element type (#16788)
add 2634d4f Updated example link
add bd5a9be Merge pull request #16848 from [BEAM-13941][Playground] Fix example link on the Playground get-started page
add dbb7b16 [BEAM-13894] Unit test utilities in the ptest package (#16830)
add 9a20032 [BEAM-13919] Annotate PerKeyOrderingTest with UsesStatefulParDo.
add 1c6d43b Merge pull request #16811 from ibzib/BEAM-13919
add 0cda6b1 [BEAM-12712] Spark: Exclude looping timer tests.
add c16e680 Merge pull request #16772 from ibzib/BEAM-12712
add 934b141 [BEAM-13922] [Coverage] Make boot.go more testable and add tests (#16833)
add d62529b Exclude SpannerChangeStream IT from Dataflow V1 postcommit (#16851)
add c558e85 [BEAM-13930] Address StateSpec consistency issue between Runner and Fn API. (#16836)
add cad8515 Add test for processing time continuation trigger
add 150e311 Merge pull request #16840: Add tests for processing time continuation trigger
No new revisions were added by this update.
Summary of changes:
.github/workflows/build_playground_backend.yml | 2 +-
.../jenkins/job_Release_NightlySnapshot.groovy | 2 +
CHANGES.md | 6 +-
.../Aggregation/Count/task-info.yaml | 2 +-
.../Aggregation/Largest/task-info.yaml | 2 +-
.../Aggregation/Mean/task-info.yaml | 2 +-
.../Aggregation/Smallest/task-info.yaml | 2 +-
.../Aggregation/Sum/task-info.yaml | 2 +-
.../Common Transforms/Filter/Filter/task-info.yaml | 2 +-
.../Common Transforms/Filter/ParDo/task-info.yaml | 7 +-
.../WithKeys/WithKeys/task-info.yaml | 2 +-
.../Common Transforms/WithKeys/WithKeys/task.py | 2 +-
.../Branching/Branching/task-info.yaml | 4 +-
.../CoGroupByKey/CoGroupByKey/task-info.yaml | 4 +-
.../Combine/Combine PerKey/task-info.yaml | 2 +-
.../Combine/CombineFn/task-info.yaml | 6 +-
.../Combine/Simple Function/task-info.yaml | 4 +-
.../Composite Transform/task-info.yaml | 6 +-
.../Core Transforms/Flatten/Flatten/task-info.yaml | 4 +-
.../GroupByKey/GroupByKey/task-info.yaml | 6 +-
.../Core Transforms/Map/FlatMap/task-info.yaml | 2 +-
.../python/Core Transforms/Map/Map/task-info.yaml | 2 +-
.../Map/ParDo OneToMany/task-info.yaml | 6 +-
.../Core Transforms/Map/ParDo/task-info.yaml | 6 +-
.../Partition/Partition/task-info.yaml | 6 +-
.../Side Input/Side Input/task-info.yaml | 6 +-
.../Core Transforms/Side Input/Side Input/task.py | 8 -
.../Side Output/Side Output/task-info.yaml | 6 +-
.../Examples/Word Count/Word Count/task-info.yaml | 4 +-
.../python/IO/TextIO/ReadFromText/task-info.yaml | 4 +-
.../katas/python/IO/TextIO/ReadFromText/task.py | 8 +
.../Hello Beam/Hello Beam/task-info.yaml | 4 +-
.../Early Triggers/Early Triggers/task-info.yaml | 6 +-
.../Triggers/Early Triggers/Early Triggers/task.py | 34 ++--
.../Early Triggers/Early Triggers/tests.py | 90 ++++-----
.../Event Time Triggers/task-info.yaml | 4 +-
.../Event Time Triggers/task.py | 41 ++---
.../Event Time Triggers/tests.py | 76 ++------
.../Window Accumulation Mode/task-info.yaml | 6 +-
.../Window Accumulation Mode/task.py | 31 ++--
.../Window Accumulation Mode/tests.py | 88 +++------
.../Adding Timestamp/ParDo/task-info.yaml | 8 +-
.../Fixed Time Window/task-info.yaml | 2 +-
learning/katas/python/requirements.txt | 6 +-
.../pipeline/src/main/proto/beam_runner_api.proto | 29 +++
playground/backend/containers/scio/Dockerfile | 1 +
.../internal/code_processing/code_processing.go | 39 ++++
.../backend/internal/fs_tool/ExampleData.scala | 33 ++++
.../backend/internal/preparers/java_preparers.go | 38 +---
playground/backend/internal/preparers/preparer.go | 33 ++++
.../backend/internal/preparers/python_preparers.go | 88 ++++++++-
.../internal/preparers/python_preparers_test.go | 8 +-
.../backend/internal/preparers/scio_preparers.go | 27 ++-
.../internal/setup_tools/builder/setup_builder.go | 3 +-
.../setup_tools/builder/setup_builder_test.go | 3 +-
.../setup_tools/life_cycle/life_cycle_setuper.go | 16 +-
playground/backend/internal/utils/common.go | 17 +-
.../backend/internal/utils/preparares_utils.go | 159 ++++++++++++++++
...tors_utils_test.go => preparares_utils_test.go} | 0
.../backend/internal/utils/preparators_utils.go | 57 ------
playground/backend/new_scio_project.sh | 2 +-
playground/frontend/lib/config/theme.dart | 17 ++
.../components/editor_textarea_wrapper.dart | 4 +-
.../pages/playground/states/playground_state.dart | 4 +-
playground/frontend/lib/playground_app.dart | 2 +-
playground/frontend/pubspec.lock | 56 ++++++
playground/frontend/pubspec.yaml | 1 +
.../core/construction/ParDoTranslation.java | 15 ++
.../core/construction/ParDoTranslationTest.java | 33 +++-
runners/google-cloud-dataflow-java/build.gradle | 1 +
runners/spark/job-server/spark_job_server.gradle | 2 +
runners/spark/spark_runner.gradle | 1 +
sdks/go/container/boot.go | 115 +++++++-----
sdks/go/container/boot_test.go | 205 +++++++++++++++++++++
sdks/go/pkg/beam/testing/ptest/ptest.go | 1 +
sdks/go/pkg/beam/testing/ptest/ptest_test.go | 62 +++++++
.../apache/beam/sdk/transforms/GroupByKeyTest.java | 116 +++++++++++-
.../beam/sdk/transforms/PerKeyOrderingTest.java | 9 +-
sdks/python/apache_beam/dataframe/schemas.py | 3 +-
sdks/python/apache_beam/portability/common_urns.py | 2 +
.../apache_beam/runners/direct/direct_runner.py | 3 +-
sdks/python/apache_beam/transforms/core.py | 17 +-
sdks/python/apache_beam/transforms/userstate.py | 17 +-
.../apache_beam/transforms/userstate_test.py | 33 ++++
website/www/site/content/en/blog/beam-2.36.0.md | 1 +
.../content/en/get-started/try-beam-playground.md | 2 +-
86 files changed, 1289 insertions(+), 509 deletions(-)
create mode 100644 playground/backend/internal/fs_tool/ExampleData.scala
create mode 100644 playground/backend/internal/utils/preparares_utils.go
rename playground/backend/internal/utils/{preparators_utils_test.go => preparares_utils_test.go} (100%)
delete mode 100644 playground/backend/internal/utils/preparators_utils.go
create mode 100644 sdks/go/container/boot_test.go
create mode 100644 sdks/go/pkg/beam/testing/ptest/ptest_test.go