You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by gi...@apache.org on 2023/11/09 03:53:18 UTC
(beam) branch nightly-refs/heads/master updated (38f3b21c5c0 -> 6bf871ff424)
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a change to branch nightly-refs/heads/master
in repository https://gitbox.apache.org/repos/asf/beam.git
from 38f3b21c5c0 Fix small typo on get_table_schema_from_string (#29340)
add 70093ced2cf set dockerMTU to 1460 to align with GKE (#29346)
add bf47289b1cd Add header removal for TextIO (#29202)
add 461c0b652fa Change BeamFnDataGrpcMultiplexer.onCompleted logging to INFO (#29259)
add 639111a2cc6 Install cbt cli for cleanup gcp resource (#29335)
add f929d084177 add missing gradle tasks to postcommit java singlestoreio test (#29348)
add bb864ab2b99 Adds a list of requirements to the expansion service that should be used to interpret the components provided.
add 2ed876f3a65 Merge pull request #29322: Adds a list of requirements to the expansion request
add 6bf871ff424 Creating a Fully Managed Beam Streaming System with Flink Runner on Kubernetes (#29305)
No new revisions were added by this update.
Summary of changes:
.../arc/config/arc_deployment.tpl | 1 +
.github/workflows/beam_CleanUpGCPResources.yml | 9 +-
.../beam_PostCommit_Java_SingleStoreIO_IT.yml | 2 +-
.test-infra/tools/stale_cbt_instances_cleaner.sh | 12 +-
CHANGES.md | 2 +
.../job_management/v1/beam_expansion_api.proto | 4 +
.../core/construction/TransformUpgrader.java | 1 +
.../main/java/org/apache/beam/sdk/io/TextIO.java | 41 ++-
.../apache/beam/sdk/io/TextRowCountEstimator.java | 10 +-
.../java/org/apache/beam/sdk/io/TextSource.java | 64 +++-
.../org/apache/beam/sdk/io/TextIOReadTest.java | 75 +++-
.../sdk/expansion/service/ExpansionService.java | 2 +-
.../sdk/fn/data/BeamFnDataGrpcMultiplexer.java | 2 +-
.../runners/portability/expansion_service.py | 3 +-
.../en/blog/apache-beam-flink-and-kubernetes.md | 403 +++++++++++++++++++++
website/www/site/data/authors.yml | 3 +
.../autoscaling-metrics.png | Bin 0 -> 79199 bytes
.../backlog-graph.png | Bin 0 -> 28754 bytes
.../fko-library.png | Bin 0 -> 176729 bytes
.../flink-checkpoint-ui.png | Bin 0 -> 413413 bytes
.../flink-deployment-yaml.png | Bin 0 -> 39477 bytes
.../gcs-write-graph.png | Bin 0 -> 228927 bytes
.../apache-beam-flink-and-kubernetes/image1.png} | Bin
.../job-metrics.png | Bin 0 -> 348117 bytes
.../job-start-activity-diagram.png | Bin 0 -> 177442 bytes
.../latency-graph.png | Bin 0 -> 81918 bytes
.../stream-service-changes.png | Bin 0 -> 1187027 bytes
.../watermark-metrics.png | Bin 0 -> 46059 bytes
28 files changed, 597 insertions(+), 37 deletions(-)
create mode 100644 website/www/site/content/en/blog/apache-beam-flink-and-kubernetes.md
create mode 100644 website/www/site/static/images/blog/apache-beam-flink-and-kubernetes/autoscaling-metrics.png
create mode 100644 website/www/site/static/images/blog/apache-beam-flink-and-kubernetes/backlog-graph.png
create mode 100644 website/www/site/static/images/blog/apache-beam-flink-and-kubernetes/fko-library.png
create mode 100644 website/www/site/static/images/blog/apache-beam-flink-and-kubernetes/flink-checkpoint-ui.png
create mode 100644 website/www/site/static/images/blog/apache-beam-flink-and-kubernetes/flink-deployment-yaml.png
create mode 100644 website/www/site/static/images/blog/apache-beam-flink-and-kubernetes/gcs-write-graph.png
copy website/www/site/static/images/{case-study/paloalto/subscription_service_scheme.png => blog/apache-beam-flink-and-kubernetes/image1.png} (100%)
create mode 100644 website/www/site/static/images/blog/apache-beam-flink-and-kubernetes/job-metrics.png
create mode 100644 website/www/site/static/images/blog/apache-beam-flink-and-kubernetes/job-start-activity-diagram.png
create mode 100644 website/www/site/static/images/blog/apache-beam-flink-and-kubernetes/latency-graph.png
create mode 100644 website/www/site/static/images/blog/apache-beam-flink-and-kubernetes/stream-service-changes.png
create mode 100644 website/www/site/static/images/blog/apache-beam-flink-and-kubernetes/watermark-metrics.png