You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by ni...@apache.org on 2022/09/26 20:55:35 UTC
[beam] branch master updated (9b77cf79625 -> f86f9e3dfd2)
This is an automated email from the ASF dual-hosted git repository.
ningk pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git
from 9b77cf79625 GA Migration PreCommit and PostCommit Tables in CI.md (#23372)
add a47daf893c7 Upgraded Flink on Dataproc support from Interacitve Beam
new f86f9e3dfd2 Upgraded Flink on Dataproc support from Interacitve Beam
The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
.../python/apache_beam/options/pipeline_options.py | 14 +++++
.../dataproc/dataproc_cluster_manager.py | 70 ++++++++++++++++++++--
.../dataproc/dataproc_cluster_manager_test.py | 7 ++-
.../runners/interactive/dataproc/types.py | 2 +-
.../runners/interactive/interactive_beam_test.py | 4 ++
.../runners/interactive/interactive_runner.py | 13 +++-
.../runners/interactive/interactive_runner_test.py | 27 +++++++++
.../interactive_environment_inspector_test.py | 2 +
8 files changed, 131 insertions(+), 8 deletions(-)
[beam] 01/01: Upgraded Flink on Dataproc support from Interacitve Beam
Posted by ni...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
ningk pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git
commit f86f9e3dfd2e7bd8fdb01d4b457268eb07d97a02
Merge: 9b77cf79625 a47daf893c7
Author: Ning Kang <ni...@gmail.com>
AuthorDate: Mon Sep 26 13:55:25 2022 -0700
Upgraded Flink on Dataproc support from Interacitve Beam
* Added parallelism and max_parallelism Flink pipeline options.
* Supported high parallelism and custom container on cloud container registry.
* Fixed a bug.
.../python/apache_beam/options/pipeline_options.py | 14 +++++
.../dataproc/dataproc_cluster_manager.py | 70 ++++++++++++++++++++--
.../dataproc/dataproc_cluster_manager_test.py | 7 ++-
.../runners/interactive/dataproc/types.py | 2 +-
.../runners/interactive/interactive_beam_test.py | 4 ++
.../runners/interactive/interactive_runner.py | 13 +++-
.../runners/interactive/interactive_runner_test.py | 27 +++++++++
.../interactive_environment_inspector_test.py | 2 +
8 files changed, 131 insertions(+), 8 deletions(-)