You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@beam.apache.org by mx...@apache.org on 2019/06/11 21:12:03 UTC

[beam] 01/01: Merge pull request #8812: [BEAM-7044] portable Spark: support stateful dofns

This is an automated email from the ASF dual-hosted git repository.

mxm pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git

commit 4f22c546a9985ae95f65ee19fada1a91e1864aca
Merge: e7aadf5 d779459
Author: Maximilian Michels <mx...@apache.org>
AuthorDate: Tue Jun 11 23:11:42 2019 +0200

    Merge pull request #8812: [BEAM-7044] portable Spark: support stateful dofns

 runners/spark/job-server/build.gradle              |  3 +-
 .../beam/runners/spark/coders/CoderHelpers.java    | 36 ++++++++---
 .../spark/translation/GroupCombineFunctions.java   | 33 +++++++++-
 .../SparkBatchPortablePipelineTranslator.java      | 70 +++++++++++++++++++---
 .../translation/SparkExecutableStageFunction.java  | 25 ++++++++
 .../spark/translation/TransformTranslator.java     |  4 +-
 .../spark/translation/TranslationUtils.java        | 31 ++++++++--
 .../runners/portability/spark_runner_test.py       |  4 --
 8 files changed, 172 insertions(+), 34 deletions(-)