You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by gi...@apache.org on 2024/02/07 03:49:54 UTC
(beam) branch nightly-refs/heads/master updated (d5aa44c9ba9 -> 7a46686577d)
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a change to branch nightly-refs/heads/master
in repository https://gitbox.apache.org/repos/asf/beam.git
from d5aa44c9ba9 Handle a user whose account was deleted. (#30192)
add a341eb69abe Added default watermark generation interval (apache#30141)
add cd5f2711c83 Merge pull request #30141: Adding a default watermark emit interval for FlinkUnboundedSourceReader
add b0f2eebb024 When failing work items during commit, make sure to call completeWork… (#30215)
add 23dcb7ec1d5 Revert "When failing work items during commit, make sure to call completeWork…" (#30228)
add 5494f114382 [Dataflow Streaming] Invalidate caches and remove work on failure before commit (#30229)
add 27f1c0774fd Bump github.com/tetratelabs/wazero from 1.5.0 to 1.6.0 in /sdks (#30222)
add 78d08235c72 Add grpc-services, grpc-utils to vendored grpc (#30196)
add 3412b4f7a5b fix markdown links (#30227)
add c006c5e2d53 Add Default method for OutputReceiver.outputWindowedValue (#30220)
add 08a717dc5c2 Creating a Fully Managed Beam Streaming System with Flink Runner on Kubernetes - Part 3 (#29860)
add 7fa4c99535f Fix to take StreamingDataflowWorkerOptions from external options (#30232)
add f08058ca75c Bump cloud.google.com/go/spanner from 1.53.1 to 1.56.0 in /sdks (#30224)
add 7a46686577d Fix a naming conflict of the TransformService test suite (#30243)
No new revisions were added by this update.
Summary of changes:
.../beam_PostCommit_TransformService_Direct.yml | 2 +-
.../apache/beam/gradle/GrpcVendoring_1_60_1.groovy | 6 +-
.../runners/core/construction/SplittableParDo.java | 10 -
.../unbounded/FlinkUnboundedSourceReader.java | 36 ++--
.../worker/DataflowBatchWorkerHarness.java | 2 +-
.../worker/DataflowWorkerHarnessHelper.java | 8 +-
.../dataflow/worker/StreamingDataflowWorker.java | 29 +--
.../worker/WorkerPipelineOptionsFactory.java | 15 +-
.../dataflow/worker/streaming/ActiveWorkState.java | 17 +-
.../worker/DataflowWorkerHarnessHelperTest.java | 30 ++-
.../worker/WorkerPipelineOptionsFactoryTest.java | 4 +-
sdks/go.mod | 28 ++-
sdks/go.sum | 48 +++--
.../java/org/apache/beam/sdk/transforms/DoFn.java | 7 +-
.../extensions/sql/zetasql/BeamZetaSqlCalcRel.java | 12 --
.../bigquery/StorageApiWriteUnshardedRecords.java | 20 --
.../apache/beam/sdk/io/gcp/spanner/SpannerIO.java | 12 --
.../beam/sdk/io/kafka/ReadFromKafkaDoFnTest.java | 11 --
.../beam/sdk/io/pulsar/ReadFromPulsarDoFnTest.java | 13 --
.../ReadFromSparkReceiverWithOffsetDoFnTest.java | 13 --
vendor/grpc-1_60_1/build.gradle | 2 +-
.../blog/apache-beam-flink-and-kubernetes-part3.md | 209 +++++++++++++++++++++
.../www/site/content/en/contribute/runner-guide.md | 12 +-
.../adaptive_scheduler_rescale.png | Bin 0 -> 859268 bytes
.../auto-tuned-worker.png | Bin 0 -> 114222 bytes
.../backlog_growth.png | Bin 0 -> 6568 bytes
.../backlog_time.png | Bin 0 -> 6127 bytes
.../cpurate_desired.png | Bin 0 -> 10111 bytes
.../flink-operator-chaining.png | Bin 0 -> 529398 bytes
.../operator-backlog.png | Bin 0 -> 350363 bytes
.../resource-allocation.png | Bin 0 -> 131782 bytes
.../worker_extra.png | Bin 0 -> 11497 bytes
.../worker_require.png | Bin 0 -> 11975 bytes
.../worker_scaleup.png | Bin 0 -> 7471 bytes
34 files changed, 360 insertions(+), 186 deletions(-)
create mode 100644 website/www/site/content/en/blog/apache-beam-flink-and-kubernetes-part3.md
create mode 100644 website/www/site/static/images/blog/apache-beam-flink-and-kubernetes-part3/adaptive_scheduler_rescale.png
create mode 100644 website/www/site/static/images/blog/apache-beam-flink-and-kubernetes-part3/auto-tuned-worker.png
create mode 100644 website/www/site/static/images/blog/apache-beam-flink-and-kubernetes-part3/backlog_growth.png
create mode 100644 website/www/site/static/images/blog/apache-beam-flink-and-kubernetes-part3/backlog_time.png
create mode 100644 website/www/site/static/images/blog/apache-beam-flink-and-kubernetes-part3/cpurate_desired.png
create mode 100644 website/www/site/static/images/blog/apache-beam-flink-and-kubernetes-part3/flink-operator-chaining.png
create mode 100644 website/www/site/static/images/blog/apache-beam-flink-and-kubernetes-part3/operator-backlog.png
create mode 100644 website/www/site/static/images/blog/apache-beam-flink-and-kubernetes-part3/resource-allocation.png
create mode 100644 website/www/site/static/images/blog/apache-beam-flink-and-kubernetes-part3/worker_extra.png
create mode 100644 website/www/site/static/images/blog/apache-beam-flink-and-kubernetes-part3/worker_require.png
create mode 100644 website/www/site/static/images/blog/apache-beam-flink-and-kubernetes-part3/worker_scaleup.png