You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by gi...@apache.org on 2021/12/23 03:46:33 UTC
[beam] branch nightly-refs/heads/master updated (a4336c9 -> af341e5)
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a change to branch nightly-refs/heads/master
in repository https://gitbox.apache.org/repos/asf/beam.git.
from a4336c9 [BEAM-13421] Fix bug with xs called with non-tuple key (#16258)
add 208f1c1 Add microbenchmark for row coder.
add 5b163e3 Compile RowCoderImpl with Cython.
add da5b6b1 RowCoder optimizations.
add 3e2d839 Further optimizations for common case of components in order.
add d742adc Optimize rows with null fields.
add 85d4fad RowCoder lint.
add 0ef6d4b Merge pull request #16316 Benchmark and optimize Python RowCoder
add 9e87d11 [BEAM-13494] Avoid draining Kinesis API limits & CPU when reading from empty or low throughput shard
add 0d0278f Merge pull request #16288: [BEAM-13494] Avoid draining Kinesis API limits & CPU when reading from empty or low throughput shard
add c211b28 [BEAM-13517] Unable to write nulls to columns with logical types
add 55f71ea Merge pull request #16323: [BEAM-13517] Unable to write nulls to columns with logical types
add af2f8ee Make S3 streaming more efficient (#15931)
add f9e862f [Playground][BEAM-13358]Deploy Go service via Ci/CD (#16210)
add c1ffd41 [BEAM-12830] Install go version w/host platform. (#16330)
add c4de94e [BEAM-13430] Clean up tests that override the time of the JVM
add 6be2090 Merge pull request #16326 from dpcollins-google/dontPolluteStatic
add 0c977e9 [BEAM-13399] Add extra time buffer to reduce likelihood of flake in expansion service test (#16331)
add c530501 [BEAM-13501] playground - add log about processing and precompiled run delay
add 2b6cb41 Merge pull request #16324 from [BEAM-13501] [Playground] Improve UX
add 5c9a1f4 [BEAM-12865] Fix triggering_frequency validation (#16315)
add 67e435d9 [BEAM-13525] Sickbay new PardoTests for Dataflow V2 Java Streaming VR (#16328)
add af341e5 [BEAM-12830] Avoid flock and prepare task once. (OSX fix.) (#16333)
No new revisions were added by this update.
Summary of changes:
.github/workflows/build_playground_backend.yml | 13 ++-
.../org/apache/beam/gradle/BeamModulePlugin.groovy | 17 ++-
.../code_repository/code_repository.dart | 26 ++++-
.../example_client/grpc_example_client.dart | 3 +-
.../pages/playground/states/playground_state.dart | 21 +++-
.../code_repository/code_repository_test.dart | 38 +++++--
.../applications/{backend => backend-go}/main.tf | 29 +++--
.../{frontend => backend-go}/variables.tf | 12 ++
runners/flink/job-server/flink_job_server.gradle | 2 +-
runners/google-cloud-dataflow-java/build.gradle | 6 +
.../fnexecution/control/RemoteExecutionTest.java | 88 ++++++++-------
...un_with_go_version.sh => prepare_go_version.sh} | 34 +++---
sdks/go/run_with_go_version.sh | 54 ++++++---
sdks/go/test/integration/xlang/expansion_test.go | 26 +++--
.../splittabledofn/WatermarkEstimatorsTest.java | 56 ++++-----
.../apache/beam/sdk/io/aws2/kinesis/KinesisIO.java | 2 +-
.../io/aws2/kinesis/RateLimitPolicyFactory.java | 76 +++++++++++++
.../aws2/kinesis/RateLimitPolicyFactoryTest.java | 81 +++++++++++++
.../io/gcp/datastore/RampupThrottlingFnTest.java | 6 +
.../java/org/apache/beam/sdk/io/jdbc/JdbcUtil.java | 16 ++-
.../org/apache/beam/sdk/io/jdbc/JdbcIOTest.java | 8 +-
.../org/apache/beam/sdk/io/kinesis/KinesisIO.java | 2 +-
.../sdk/io/kinesis/RateLimitPolicyFactory.java | 76 +++++++++++++
.../sdk/io/kinesis/RateLimitPolicyFactoryTest.java | 64 ++++++++++-
sdks/python/apache_beam/coders/coder_impl.pxd | 27 +++++
sdks/python/apache_beam/coders/coder_impl.py | 125 ++++++++++++++++++++-
sdks/python/apache_beam/coders/row_coder.py | 112 +-----------------
.../apache_beam/io/aws/clients/s3/boto3_client.py | 117 ++++++++++---------
sdks/python/apache_beam/io/gcp/bigquery.py | 10 +-
sdks/python/apache_beam/io/gcp/bigquery_test.py | 68 ++++++++---
.../apache_beam/tools/coders_microbenchmark.py | 41 ++++++-
sdks/python/apache_beam/utils/retry.py | 2 +-
32 files changed, 912 insertions(+), 346 deletions(-)
copy playground/terraform/applications/{backend => backend-go}/main.tf (70%)
copy playground/terraform/applications/{frontend => backend-go}/variables.tf (88%)
copy sdks/go/{run_with_go_version.sh => prepare_go_version.sh} (65%)
create mode 100644 sdks/java/io/amazon-web-services2/src/test/java/org/apache/beam/sdk/io/aws2/kinesis/RateLimitPolicyFactoryTest.java