You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by gi...@apache.org on 2024/02/07 03:49:54 UTC

(beam) branch nightly-refs/heads/master updated (d5aa44c9ba9 -> 7a46686577d)

This is an automated email from the ASF dual-hosted git repository.

github-bot pushed a change to branch nightly-refs/heads/master
in repository https://gitbox.apache.org/repos/asf/beam.git


    from d5aa44c9ba9 Handle a user whose account was deleted. (#30192)
     add a341eb69abe Added default watermark generation interval (apache#30141)
     add cd5f2711c83 Merge pull request #30141: Adding a default watermark emit interval for FlinkUnboundedSourceReader
     add b0f2eebb024 When failing work items during commit, make sure to call completeWork… (#30215)
     add 23dcb7ec1d5 Revert "When failing work items during commit, make sure to call completeWork…" (#30228)
     add 5494f114382 [Dataflow Streaming] Invalidate caches and remove work on failure before commit (#30229)
     add 27f1c0774fd Bump github.com/tetratelabs/wazero from 1.5.0 to 1.6.0 in /sdks (#30222)
     add 78d08235c72 Add grpc-services, grpc-utils to vendored grpc (#30196)
     add 3412b4f7a5b fix markdown links (#30227)
     add c006c5e2d53 Add Default method for OutputReceiver.outputWindowedValue (#30220)
     add 08a717dc5c2 Creating a Fully Managed Beam Streaming System with Flink Runner on Kubernetes - Part 3 (#29860)
     add 7fa4c99535f Fix to take StreamingDataflowWorkerOptions from external options (#30232)
     add f08058ca75c Bump cloud.google.com/go/spanner from 1.53.1 to 1.56.0 in /sdks (#30224)
     add 7a46686577d Fix a naming conflict of the TransformService test suite (#30243)

No new revisions were added by this update.

Summary of changes:
 .../beam_PostCommit_TransformService_Direct.yml    |   2 +-
 .../apache/beam/gradle/GrpcVendoring_1_60_1.groovy |   6 +-
 .../runners/core/construction/SplittableParDo.java |  10 -
 .../unbounded/FlinkUnboundedSourceReader.java      |  36 ++--
 .../worker/DataflowBatchWorkerHarness.java         |   2 +-
 .../worker/DataflowWorkerHarnessHelper.java        |   8 +-
 .../dataflow/worker/StreamingDataflowWorker.java   |  29 +--
 .../worker/WorkerPipelineOptionsFactory.java       |  15 +-
 .../dataflow/worker/streaming/ActiveWorkState.java |  17 +-
 .../worker/DataflowWorkerHarnessHelperTest.java    |  30 ++-
 .../worker/WorkerPipelineOptionsFactoryTest.java   |   4 +-
 sdks/go.mod                                        |  28 ++-
 sdks/go.sum                                        |  48 +++--
 .../java/org/apache/beam/sdk/transforms/DoFn.java  |   7 +-
 .../extensions/sql/zetasql/BeamZetaSqlCalcRel.java |  12 --
 .../bigquery/StorageApiWriteUnshardedRecords.java  |  20 --
 .../apache/beam/sdk/io/gcp/spanner/SpannerIO.java  |  12 --
 .../beam/sdk/io/kafka/ReadFromKafkaDoFnTest.java   |  11 --
 .../beam/sdk/io/pulsar/ReadFromPulsarDoFnTest.java |  13 --
 .../ReadFromSparkReceiverWithOffsetDoFnTest.java   |  13 --
 vendor/grpc-1_60_1/build.gradle                    |   2 +-
 .../blog/apache-beam-flink-and-kubernetes-part3.md | 209 +++++++++++++++++++++
 .../www/site/content/en/contribute/runner-guide.md |  12 +-
 .../adaptive_scheduler_rescale.png                 | Bin 0 -> 859268 bytes
 .../auto-tuned-worker.png                          | Bin 0 -> 114222 bytes
 .../backlog_growth.png                             | Bin 0 -> 6568 bytes
 .../backlog_time.png                               | Bin 0 -> 6127 bytes
 .../cpurate_desired.png                            | Bin 0 -> 10111 bytes
 .../flink-operator-chaining.png                    | Bin 0 -> 529398 bytes
 .../operator-backlog.png                           | Bin 0 -> 350363 bytes
 .../resource-allocation.png                        | Bin 0 -> 131782 bytes
 .../worker_extra.png                               | Bin 0 -> 11497 bytes
 .../worker_require.png                             | Bin 0 -> 11975 bytes
 .../worker_scaleup.png                             | Bin 0 -> 7471 bytes
 34 files changed, 360 insertions(+), 186 deletions(-)
 create mode 100644 website/www/site/content/en/blog/apache-beam-flink-and-kubernetes-part3.md
 create mode 100644 website/www/site/static/images/blog/apache-beam-flink-and-kubernetes-part3/adaptive_scheduler_rescale.png
 create mode 100644 website/www/site/static/images/blog/apache-beam-flink-and-kubernetes-part3/auto-tuned-worker.png
 create mode 100644 website/www/site/static/images/blog/apache-beam-flink-and-kubernetes-part3/backlog_growth.png
 create mode 100644 website/www/site/static/images/blog/apache-beam-flink-and-kubernetes-part3/backlog_time.png
 create mode 100644 website/www/site/static/images/blog/apache-beam-flink-and-kubernetes-part3/cpurate_desired.png
 create mode 100644 website/www/site/static/images/blog/apache-beam-flink-and-kubernetes-part3/flink-operator-chaining.png
 create mode 100644 website/www/site/static/images/blog/apache-beam-flink-and-kubernetes-part3/operator-backlog.png
 create mode 100644 website/www/site/static/images/blog/apache-beam-flink-and-kubernetes-part3/resource-allocation.png
 create mode 100644 website/www/site/static/images/blog/apache-beam-flink-and-kubernetes-part3/worker_extra.png
 create mode 100644 website/www/site/static/images/blog/apache-beam-flink-and-kubernetes-part3/worker_require.png
 create mode 100644 website/www/site/static/images/blog/apache-beam-flink-and-kubernetes-part3/worker_scaleup.png