You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by gi...@apache.org on 2021/04/28 02:51:06 UTC
[beam] tag nightly-master updated (e13e548 -> 4202fb8)
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a change to tag nightly-master
in repository https://gitbox.apache.org/repos/asf/beam.git.
*** WARNING: tag nightly-master was modified! ***
from e13e548 (commit)
to 4202fb8 (commit)
from e13e548 [BEAM-10029] Adds Grafana config for Spanner IO Perf Metrics (#14643)
add ef654f6 Close ZipOutputStream
add 9505f4e Merge pull request #14631: [BEAM-12220] Close ZipOutputStream to avoid native memory leak
add 93fe942 [BEAM-12226] JdbcIO DefaultRetryStrategy: retry on PostgreSQL-specific 40P01 error code
add d152c9c Merge pull request #14646: [BEAM-12226] JdbcIO DefaultRetryStrategy: retry on PostgreSQL-specific 40P01 error code
add 46b704a Clarify when to use `@DefaultCoder` (#14326)
add 422db52 [BEAM-12231] Update Dataflow container to adjust for API changes
add a2230e0 Merge pull request #14651: [BEAM-12231] Update Dataflow container to adjust for API changes
add 4774c1c [BEAM-12232] Expose public factory methods in SparkJobServerDriver (#14652)
add 729129e Add View.toList pipeline to translator tests
add 1c2b9bc Temporarily disable FnApiDoFnRunnerTest.testUsingMetrics
add 4492fa3 Resolve beam_fn_api experiment for side inputs, using portable expansion always
add 72fc94d Merge #14641: [BEAM-12222] Use portable side input expansion always
add 3981686 [BEAM-12221] Add experimental pipeline option to control the execution state sampling period.
add 8532acb Merge pull request #14632 from y1chi/sampler
add 8821163 [BEAM-11994] Refactor BigQueryTornadoes to make more options parameterizable.
add 33fe359 Merge pull request #14489: [BEAM-11994] Refactor BigQueryTornadoes to make more options parameterizable
add c046d7f [BEAM-12009] Enable Calc splitting rule by default.
add def1ea6 Merge pull request #14655 from ibzib/enable-calc-splitting
add ebdfee9 [BEAM-12016] Initial implementation for add_suffix, add_prefix (#14623)
add eca1426 [BEAM-12045] Install google cloud profiler agent in java sdk container image
add fe2fc9d Merge pull request #14598 from y1chi/profiler
add b379725 [BEAM-12237] Fix logging in Samza Runner (#14657)
add 62d6d41 Fix worker_pool plumbing to use a mutable List.
add 4202fb8 Merge pull request #14661 - Fix worker_pool plumbing to use a mutable List.
No new revisions were added by this update.
Summary of changes:
.../beam/examples/cookbook/BigQueryTornadoes.java | 91 +++++++------
.../src/main/proto/beam_provision_api.proto | 4 +
.../core/construction/MorePipelineTest.java | 21 ++-
.../core/metrics/ExecutionStateSampler.java | 14 +-
runners/google-cloud-dataflow-java/build.gradle | 2 +-
.../dataflow/DataflowPipelineTranslatorTest.java | 101 ++++++++++++++
.../dataflow/worker/DataflowWorkUnitClient.java | 8 +-
.../dataflow/worker/IsmSideInputReader.java | 35 +++--
runners/samza/build.gradle | 4 +
runners/samza/src/main/resources/log4j.properties | 3 +-
.../beam/runners/spark/SparkJobServerDriver.java | 4 +-
.../model/fnexecution_v1/beam_provision_api.pb.go | 104 ++++++++------
sdks/java/container/Dockerfile | 3 +
sdks/java/container/boot.go | 20 ++-
sdks/java/container/build.gradle | 6 +
sdks/java/container/common.gradle | 1 +
.../beam/sdk/options/ExperimentalOptions.java | 2 +
.../org/apache/beam/sdk/transforms/Combine.java | 36 +----
.../java/org/apache/beam/sdk/transforms/View.java | 150 +++++----------------
.../java/org/apache/beam/sdk/util/ZipFiles.java | 1 +
.../apache/beam/sdk/values/PCollectionViews.java | 60 ++++++++-
.../beam/sdk/testing/PCollectionViewTesting.java | 108 +++++----------
.../sql/zetasql/ZetaSQLQueryPlanner.java | 3 +-
.../extensions/sql/zetasql/ZetaSqlJavaUdfTest.java | 15 ---
.../sql/zetasql/ZetaSqlJavaUdfTypeTest.java | 12 +-
.../java/org/apache/beam/fn/harness/FnHarness.java | 6 +
.../beam/fn/harness/FnApiDoFnRunnerTest.java | 2 +
.../java/org/apache/beam/sdk/io/jdbc/JdbcIO.java | 13 +-
.../org/apache/beam/sdk/io/jdbc/JdbcIOTest.java | 11 +-
sdks/python/apache_beam/dataframe/frames.py | 13 ++
sdks/python/apache_beam/dataframe/frames_test.py | 14 ++
.../apache_beam/dataframe/pandas_doctests_test.py | 2 -
.../content/en/documentation/programming-guide.md | 17 ++-
33 files changed, 512 insertions(+), 374 deletions(-)