You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by gi...@apache.org on 2022/03/19 04:08:22 UTC
[beam] branch nightly-refs/heads/master updated (4c979cc -> dc12478)
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a change to branch nightly-refs/heads/master
in repository https://gitbox.apache.org/repos/asf/beam.git.
from 4c979cc Merge pull request #16954 from lukecwik/beam10212
add 31ed331 Merge pull request #16977 from [BEAM-12164] Added integration test for transaction boundaries and transaction ID ordering.
add 6095876 [adhoc] Minor cleanup for aws2 tests
add d7f7f8e Merge pull request #17117 from mosche/adhoc-cleanup-aws2-tests
add 44aa718 [BEAM-14125] Update website IO matrix to recommend aws2 IOs
add e779418 Merge pull request #17119: [BEAM-14125] Update website IO matrix to recommend aws2 IOs
add 65df6af [BEAM-14128] Eliminating quadratic behavior of computeCompositeInputOutput (#17120)
add 9094932 Add Java 17 Nexmark metrics to Grafana
add 60f8f35 Merge pull request #17008 from kileys/java17
add 9a548b2 [BEAM-13972] Add RunInference interface (#16917)
add 688366a Merge pull request #17116 from [BEAM-12164] Remove change_stream in request tag
add ed56013 Deprecate tags.go (#17025)
add 4976b2e [BEAM-12753] and [BEAM-12815] Fix Flink Integration Tests (#17067)
add 1a4b707 Merge pull request #16895 from [BEAM-13882][Playground] More tests for validators package
add 518c7ff [BEAM-13925] Add weekly automation to update our reviewer config (#17034)
add 0a807c6 Merge pull request #17076 from Beam 14082 update payground for mobile
add da1b303 [BEAM-13925] Assign committers in the scheduled action (#17062)
add f539c49 Pin setup-gcloud to v0 instead of master (#17123)
add 06bcd6a [BEAM-3304] documentation for PaneInfo in BPG (#17047)
add 590bed9 Merge pull request #17016 from [BEAM-14049][Playground] Add new API method to get Precompiled Object
add 235e4a9 Merge pull request #17077 from [BEAM-14078] [Website] change link
add 95a650e Merge pull request #17085 from [BEAM-14077] [Website] add beam playground section
add 5494ec8 [BEAM-14098] wrapper for postgres on JDBC IO GO SDK (#17088)
add 12f9635 .
add a1c50f7 .
add 742d4b6 .
add 055ba2d format fix
add 9ae036f .
add d54d052 make DoFn into a separate class
add 7aff197 .
add 2883542 fix setting
add c626e5c fix checkstyle
add 9fe56d3 spotlessapply
add dc12478 Merge pull request #17038: [BEAM-13747] Add e2e test for BigQuery Write API beam connector
No new revisions were added by this update.
Summary of changes:
.github/REVIEWERS.yml | 18 +-
.github/workflows/build_wheels.yml | 8 +-
.github/workflows/java_tests.yml | 2 +-
.github/workflows/playground_deploy_examples.yml | 2 +-
.github/workflows/pr-bot-pr-updates.yml | 2 -
...bot-new-prs.yml => pr-bot-update-reviewers.yml} | 10 +-
.github/workflows/python_tests.yml | 2 +-
.../Nexmark_Dataflow_RunnerV2.json | 22 +
playground/api/v1/api.proto | 13 +
playground/backend/cmd/server/controller.go | 12 +
playground/backend/internal/api/v1/api.pb.go | 682 +++++++++++++--------
playground/backend/internal/api/v1/api_grpc.pb.go | 38 ++
.../internal/cloud_bucket/precompiled_objects.go | 22 +-
.../cloud_bucket/precompiled_objects_test.go | 8 +-
.../internal/preparers/go_preparers_test.go | 62 +-
.../backend/internal/preparers/java_preparers.go | 55 +-
.../internal/preparers/java_preparers_test.go | 58 +-
.../backend/internal/preparers/preparer_test.go | 180 ++++++
.../backend/internal/preparers/python_preparers.go | 2 +-
.../internal/preparers/python_preparers_test.go | 165 ++++-
.../backend/internal/preparers/scio_preparers.go | 21 +-
.../internal/preparers/scio_preparers_test.go | 40 +-
.../{preparares_utils.go => preparers_utils.go} | 23 +
...rares_utils_test.go => preparers_utils_test.go} | 0
.../internal/validators/go_validators_test.go | 15 +-
.../internal/validators/java_validators_test.go | 8 +-
...alidators_test.go => python_validators_test.go} | 50 +-
.../backend/internal/validators/validator.go | 5 +-
.../backend/internal/validators/validator_test.go | 43 +-
playground/frontend/lib/api/v1/api.pb.dart | 96 +++
playground/frontend/lib/api/v1/api.pbgrpc.dart | 29 +
playground/frontend/lib/api/v1/api.pbjson.dart | 20 +
playground/infrastructure/api/v1/api_pb2.py | 163 +++--
playground/infrastructure/api/v1/api_pb2_grpc.py | 34 +
scripts/ci/pr-bot/package.json | 1 +
scripts/ci/pr-bot/processNewPrs.ts | 76 ++-
scripts/ci/pr-bot/processPrUpdate.ts | 72 +--
scripts/ci/pr-bot/shared/commentStrings.ts | 40 +-
scripts/ci/pr-bot/shared/constants.ts | 1 +
scripts/ci/pr-bot/shared/pr.ts | 5 +
scripts/ci/pr-bot/shared/reviewerConfig.ts | 48 +-
scripts/ci/pr-bot/updateReviewers.ts | 302 +++++++++
sdks/go/examples/snippets/04transforms.go | 20 +-
sdks/go/pkg/beam/core/runtime/pipelinex/replace.go | 39 +-
.../beam/core/runtime/pipelinex/replace_test.go | 24 +
sdks/go/pkg/beam/core/util/reflectx/tags.go | 15 +
sdks/go/pkg/beam/forward.go | 3 +
sdks/go/pkg/beam/io/xlang/jdbcio/jdbc.go | 56 +-
sdks/go/test/integration/integration.go | 6 +-
sdks/go/test/integration/io/xlang/jdbc/jdbc.go | 21 +
.../go/test/integration/io/xlang/jdbc/jdbc_test.go | 20 +
.../go/test/integration/primitives/window_panes.go | 3 +-
.../src => sdks/go}/test/resources/flink-conf.yaml | 3 +-
sdks/go/test/run_validatesrunner_tests.sh | 4 +
.../sdk/io/aws2/dynamodb/DynamoDBIOWriteTest.java | 4 -
.../org/apache/beam/sdk/io/aws2/sns/SnsIOTest.java | 4 -
.../spanner/changestreams/dao/ChangeStreamDao.java | 12 +-
.../io/gcp/bigquery/BigQueryIOStorageWriteIT.java | 130 ++++
...StreamOrderedByTimestampAndTransactionIdIT.java | 582 ++++++++++++++++++
...nnerChangeStreamOrderedWithinKeyGloballyIT.java | 203 ++----
.../it/SpannerChangeStreamOrderedWithinKeyIT.java | 1 +
...SpannerChangeStreamTransactionBoundariesIT.java | 402 ++++++++++++
sdks/python/apache_beam/ml/inference/api.py | 74 +++
.../assets/scss/{_header.sass => _playground.sass} | 25 +-
website/www/site/assets/scss/main.scss | 1 +
.../content/en/documentation/programming-guide.md | 9 +-
.../documentation/resources/learning-resources.md | 6 +
.../en/documentation/runtime/environments.md | 1 +
.../content/en/get-started/try-beam-playground.md | 4 +-
website/www/site/data/io_matrix.yaml | 24 +-
website/www/site/layouts/index.html | 3 +
website/www/site/static/images/playground.png | Bin 0 -> 213806 bytes
72 files changed, 3280 insertions(+), 874 deletions(-)
copy .github/workflows/{pr-bot-new-prs.yml => pr-bot-update-reviewers.yml} (88%)
create mode 100644 playground/backend/internal/preparers/preparer_test.go
copy learning/katas/go/common_transforms/aggregation/mean/test/task_test.go => playground/backend/internal/preparers/scio_preparers_test.go (57%)
rename playground/backend/internal/utils/{preparares_utils.go => preparers_utils.go} (89%)
rename playground/backend/internal/utils/{preparares_utils_test.go => preparers_utils_test.go} (100%)
copy playground/backend/internal/validators/{go_validators_test.go => python_validators_test.go} (55%)
create mode 100644 scripts/ci/pr-bot/updateReviewers.ts
copy {runners/flink/src => sdks/go}/test/resources/flink-conf.yaml (91%)
create mode 100644 sdks/java/io/google-cloud-platform/src/test/java/org/apache/beam/sdk/io/gcp/bigquery/BigQueryIOStorageWriteIT.java
create mode 100644 sdks/java/io/google-cloud-platform/src/test/java/org/apache/beam/sdk/io/gcp/spanner/changestreams/it/SpannerChangeStreamOrderedByTimestampAndTransactionIdIT.java
create mode 100644 sdks/java/io/google-cloud-platform/src/test/java/org/apache/beam/sdk/io/gcp/spanner/changestreams/it/SpannerChangeStreamTransactionBoundariesIT.java
create mode 100644 sdks/python/apache_beam/ml/inference/api.py
copy website/www/site/assets/scss/{_header.sass => _playground.sass} (71%)
create mode 100644 website/www/site/static/images/playground.png