You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by ie...@apache.org on 2018/10/05 09:01:30 UTC
[beam] branch master updated (fed2d1d -> e4a1ccb)
This is an automated email from the ASF dual-hosted git repository.
iemejia pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git.
from fed2d1d Merge pull request #6568 from iemejia/BEAM-5532-spark-runner
add aa20352 Remove defaultParallelism when bounded.
add 9ed127e Remove defaultParallelism using bundleSize.
add 9b800ac Incorporate requested changes.
new e4a1ccb Merge pull request #6181: [BEAM-4783] Add bundleSize for splitting BoundedSources
The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
.../beam/runners/spark/SparkPipelineOptions.java | 11 ++++++++
.../apache/beam/runners/spark/io/SourceRDD.java | 31 +++++++++++++---------
.../spark/translation/GroupCombineFunctions.java | 18 ++++++++-----
.../spark/translation/TransformTranslator.java | 14 ++++++++--
.../streaming/StreamingTransformTranslator.java | 3 ++-
5 files changed, 56 insertions(+), 21 deletions(-)
[beam] 01/01: Merge pull request #6181: [BEAM-4783] Add bundleSize
for splitting BoundedSources
Posted by ie...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
iemejia pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git
commit e4a1ccbaa10808d88c6ad2a687fe9f6d52392d90
Merge: fed2d1d 9b800ac
Author: Ismaël Mejía <ie...@gmail.com>
AuthorDate: Fri Oct 5 11:01:05 2018 +0200
Merge pull request #6181: [BEAM-4783] Add bundleSize for splitting BoundedSources
.../beam/runners/spark/SparkPipelineOptions.java | 11 ++++++++
.../apache/beam/runners/spark/io/SourceRDD.java | 31 +++++++++++++---------
.../spark/translation/GroupCombineFunctions.java | 18 ++++++++-----
.../spark/translation/TransformTranslator.java | 14 ++++++++--
.../streaming/StreamingTransformTranslator.java | 3 ++-
5 files changed, 56 insertions(+), 21 deletions(-)