You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by gi...@apache.org on 2023/11/09 03:53:18 UTC

(beam) branch nightly-refs/heads/master updated (38f3b21c5c0 -> 6bf871ff424)

This is an automated email from the ASF dual-hosted git repository.

github-bot pushed a change to branch nightly-refs/heads/master
in repository https://gitbox.apache.org/repos/asf/beam.git


    from 38f3b21c5c0 Fix small typo on get_table_schema_from_string (#29340)
     add 70093ced2cf set dockerMTU to 1460 to align with GKE (#29346)
     add bf47289b1cd Add header removal for TextIO (#29202)
     add 461c0b652fa Change BeamFnDataGrpcMultiplexer.onCompleted logging to INFO (#29259)
     add 639111a2cc6 Install cbt cli for cleanup gcp resource (#29335)
     add f929d084177 add missing gradle tasks to postcommit java singlestoreio test (#29348)
     add bb864ab2b99 Adds a list of requirements to the expansion service that should be used to interpret the components provided.
     add 2ed876f3a65 Merge pull request #29322: Adds a list of requirements to the expansion request
     add 6bf871ff424 Creating a Fully Managed Beam Streaming System with Flink Runner on Kubernetes (#29305)

No new revisions were added by this update.

Summary of changes:
 .../arc/config/arc_deployment.tpl                  |   1 +
 .github/workflows/beam_CleanUpGCPResources.yml     |   9 +-
 .../beam_PostCommit_Java_SingleStoreIO_IT.yml      |   2 +-
 .test-infra/tools/stale_cbt_instances_cleaner.sh   |  12 +-
 CHANGES.md                                         |   2 +
 .../job_management/v1/beam_expansion_api.proto     |   4 +
 .../core/construction/TransformUpgrader.java       |   1 +
 .../main/java/org/apache/beam/sdk/io/TextIO.java   |  41 ++-
 .../apache/beam/sdk/io/TextRowCountEstimator.java  |  10 +-
 .../java/org/apache/beam/sdk/io/TextSource.java    |  64 +++-
 .../org/apache/beam/sdk/io/TextIOReadTest.java     |  75 +++-
 .../sdk/expansion/service/ExpansionService.java    |   2 +-
 .../sdk/fn/data/BeamFnDataGrpcMultiplexer.java     |   2 +-
 .../runners/portability/expansion_service.py       |   3 +-
 .../en/blog/apache-beam-flink-and-kubernetes.md    | 403 +++++++++++++++++++++
 website/www/site/data/authors.yml                  |   3 +
 .../autoscaling-metrics.png                        | Bin 0 -> 79199 bytes
 .../backlog-graph.png                              | Bin 0 -> 28754 bytes
 .../fko-library.png                                | Bin 0 -> 176729 bytes
 .../flink-checkpoint-ui.png                        | Bin 0 -> 413413 bytes
 .../flink-deployment-yaml.png                      | Bin 0 -> 39477 bytes
 .../gcs-write-graph.png                            | Bin 0 -> 228927 bytes
 .../apache-beam-flink-and-kubernetes/image1.png}   | Bin
 .../job-metrics.png                                | Bin 0 -> 348117 bytes
 .../job-start-activity-diagram.png                 | Bin 0 -> 177442 bytes
 .../latency-graph.png                              | Bin 0 -> 81918 bytes
 .../stream-service-changes.png                     | Bin 0 -> 1187027 bytes
 .../watermark-metrics.png                          | Bin 0 -> 46059 bytes
 28 files changed, 597 insertions(+), 37 deletions(-)
 create mode 100644 website/www/site/content/en/blog/apache-beam-flink-and-kubernetes.md
 create mode 100644 website/www/site/static/images/blog/apache-beam-flink-and-kubernetes/autoscaling-metrics.png
 create mode 100644 website/www/site/static/images/blog/apache-beam-flink-and-kubernetes/backlog-graph.png
 create mode 100644 website/www/site/static/images/blog/apache-beam-flink-and-kubernetes/fko-library.png
 create mode 100644 website/www/site/static/images/blog/apache-beam-flink-and-kubernetes/flink-checkpoint-ui.png
 create mode 100644 website/www/site/static/images/blog/apache-beam-flink-and-kubernetes/flink-deployment-yaml.png
 create mode 100644 website/www/site/static/images/blog/apache-beam-flink-and-kubernetes/gcs-write-graph.png
 copy website/www/site/static/images/{case-study/paloalto/subscription_service_scheme.png => blog/apache-beam-flink-and-kubernetes/image1.png} (100%)
 create mode 100644 website/www/site/static/images/blog/apache-beam-flink-and-kubernetes/job-metrics.png
 create mode 100644 website/www/site/static/images/blog/apache-beam-flink-and-kubernetes/job-start-activity-diagram.png
 create mode 100644 website/www/site/static/images/blog/apache-beam-flink-and-kubernetes/latency-graph.png
 create mode 100644 website/www/site/static/images/blog/apache-beam-flink-and-kubernetes/stream-service-changes.png
 create mode 100644 website/www/site/static/images/blog/apache-beam-flink-and-kubernetes/watermark-metrics.png