You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by gi...@apache.org on 2021/10/26 03:55:39 UTC
[beam] tag nightly-master updated (6173abb -> fd4eb15)
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a change to tag nightly-master
in repository https://gitbox.apache.org/repos/asf/beam.git.
*** WARNING: tag nightly-master was modified! ***
from 6173abb (commit)
to fd4eb15 (commit)
from 6173abb [BEAM-13015] Create a multiplexer that sends Elements based upon instruction id allowing for an inbound observer responsible for the entire instruction id. (#15747)
add 1f08d1f Fixing BigQueryIO request too big corner case for streaming inserts (#15067)
add 43d3b90 Merge pull request #15772 from [BEAM-13032] [Playground] Implement the Log service
add 47a9b3f Merge pull request #15714 from [BEAM-13005] [Playground] Implement local cache for pipelines' states
add aa26b53 Add environment_service.go and structures for beam sdk, network envs, cache and application envs
add 835d19a Merge pull request #15654 from [BEAM-12998] [Playground] Environment service
add b911642 Merge pull request #15770 from [BEAM-13095][Playground] Using working directory from environment in LifeCycle instead of using hardcoded backend directory
add 39613ea [BEAM-11758] Update basics page: Aggregation, Runner, UDF, Schema (#15763)
add 6e821f7 [BEAM-13062][Playground] add STATUS_COMPILE_ERROR; add STATUS_RUN_TIMEOUT; update proto command in README file to generate files;
add d463c0c [BEAM-13062][Playground] update README file; generate files for backend
add 9b3198f Merge pull request #15787 from [BEAM-13062][Playground] Update errors in Protobuf
add b52932c Merge pull request #15783 from [BEAM-13048] [Playground] Add shortcuts
add 480e52c [BEAM-8543] Fix test filtering for Dataflow Runner V2 to exclude UsesStrictTimerOrdering
add e1b83ba [BEAM-8543] Fix test filtering for Dataflow Runner V2 to exclude UsesStrictTimerOrdering
add 9cfcfbe [BEAM-12522] Enable side inputs on all splittable DoFn execution time related methods for portable runners.
add fd4eb15 [BEAM-12522] Enable side inputs on all splittable DoFn execution time related methods.
No new revisions were added by this update.
Summary of changes:
playground/api/v1/api.proto | 2 +
playground/backend/README.md | 27 +-
playground/backend/cmd/server/http.go | 2 +-
playground/backend/cmd/server/server.go | 23 +-
playground/backend/configs/SDK_JAVA.json | 13 +
playground/backend/go.mod | 1 +
playground/backend/go.sum | 328 +++++++++++++++-
playground/backend/internal/api/v1/api.pb.go | 84 ++--
playground/backend/internal/api/v1/api_grpc.pb.go | 17 +-
playground/backend/internal/cache/cache.go | 57 +++
.../backend/internal/cache/local/local_cache.go | 134 +++++++
.../internal/cache/local/local_cache_test.go | 365 ++++++++++++++++++
.../backend/internal/environment/application.go | 98 +++++
.../internal/environment/application_test.go | 261 +++++++++++++
playground/backend/internal/environment/beam.go | 43 +++
.../backend/internal/environment/environment.go | 28 --
.../internal/environment/environment_service.go | 193 ++++++++++
.../environment/environment_service_test.go | 283 ++++++++++++++
playground/backend/internal/fs_tool/fs.go | 87 +----
playground/backend/internal/fs_tool/fs_test.go | 45 ++-
playground/backend/internal/fs_tool/java_fs.go | 14 +-
.../backend/internal/fs_tool/java_fs_test.go | 11 +-
.../internal/logger/cloud_logging_handler.go | 88 +++++
playground/backend/internal/logger/handler.go | 53 +++
playground/backend/internal/logger/logger.go | 121 ++++++
playground/backend/internal/logger/logger_test.go | 422 +++++++++++++++++++++
playground/frontend/lib/config/theme.dart | 12 +
playground/frontend/lib/constants/sizes.dart | 1 +
.../modules/shortcuts/components/shortcut_row.dart | 63 +++
.../shortcuts/components/shortcuts_manager.dart} | 43 ++-
.../shortcuts/components/shortcuts_modal.dart | 85 +++++
.../shortcuts/constants/global_shortcuts.dart | 103 +++++
.../lib/modules/shortcuts/models/shortcut.dart | 23 +-
.../pages/playground/components/more_actions.dart | 14 +-
.../lib/pages/playground/playground_page.dart | 6 +-
.../pages/playground/states/playground_state.dart | 5 +
playground/frontend/lib/playground_app.dart | 17 +-
.../runners/core/construction/SplittableParDo.java | 79 +++-
.../construction/SplittableParDoNaiveBounded.java | 49 ++-
...TimeBoundedSplittableProcessElementInvoker.java | 13 +-
.../core/SplittableParDoViaKeyedWorkItems.java | 74 +++-
.../core/SplittableProcessElementInvoker.java | 5 +-
...BoundedSplittableProcessElementInvokerTest.java | 4 +-
.../runners/core/SplittableParDoProcessFnTest.java | 4 +-
.../SplittableProcessElementsEvaluatorFactory.java | 9 +-
runners/flink/job-server/flink_job_server.gradle | 1 -
.../wrappers/streaming/SplittableDoFnOperator.java | 1 +
runners/google-cloud-dataflow-java/build.gradle | 7 +-
.../worker/SplittableProcessFnFactory.java | 4 +-
runners/samza/job-server/build.gradle | 1 -
.../SplittableParDoProcessKeyedElementsOp.java | 1 +
runners/spark/job-server/spark_job_server.gradle | 2 -
.../beam/sdk/transforms/reflect/DoFnSignature.java | 7 +-
.../sdk/transforms/reflect/DoFnSignatures.java | 21 +-
.../beam/sdk/transforms/SplittableDoFnTest.java | 233 +++++++++---
.../reflect/DoFnSignaturesSplittableDoFnTest.java | 21 +-
.../sdk/io/gcp/bigquery/BigQueryServicesImpl.java | 248 +++++++-----
.../io/gcp/bigquery/BigQueryServicesImplTest.java | 109 +++++-
.../beam/sdk/io/gcp/bigquery/BigQueryUtilTest.java | 45 +--
.../www/site/content/en/documentation/basics.md | 205 +++++++---
.../content/en/documentation/programming-guide.md | 17 +
website/www/site/static/images/aggregation.png | Bin 0 -> 14065 bytes
62 files changed, 3806 insertions(+), 526 deletions(-)
create mode 100644 playground/backend/configs/SDK_JAVA.json
create mode 100644 playground/backend/internal/cache/cache.go
create mode 100644 playground/backend/internal/cache/local/local_cache.go
create mode 100644 playground/backend/internal/cache/local/local_cache_test.go
create mode 100644 playground/backend/internal/environment/application.go
create mode 100644 playground/backend/internal/environment/application_test.go
create mode 100644 playground/backend/internal/environment/beam.go
delete mode 100644 playground/backend/internal/environment/environment.go
create mode 100644 playground/backend/internal/environment/environment_service.go
create mode 100644 playground/backend/internal/environment/environment_service_test.go
create mode 100644 playground/backend/internal/logger/cloud_logging_handler.go
create mode 100644 playground/backend/internal/logger/handler.go
create mode 100644 playground/backend/internal/logger/logger.go
create mode 100644 playground/backend/internal/logger/logger_test.go
create mode 100644 playground/frontend/lib/modules/shortcuts/components/shortcut_row.dart
copy playground/frontend/lib/{playground_app.dart => modules/shortcuts/components/shortcuts_manager.dart} (53%)
create mode 100644 playground/frontend/lib/modules/shortcuts/components/shortcuts_modal.dart
create mode 100644 playground/frontend/lib/modules/shortcuts/constants/global_shortcuts.dart
rename sdks/java/core/src/main/java/org/apache/beam/sdk/testing/UsesSplittableParDoWithWindowedSideInputs.java => playground/frontend/lib/modules/shortcuts/models/shortcut.dart (71%)
create mode 100755 website/www/site/static/images/aggregation.png