You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@beam.apache.org by ro...@apache.org on 2019/05/24 08:49:18 UTC

[beam] branch master updated (ea32ab9 -> 05b9dbe)

This is an automated email from the ASF dual-hosted git repository.

robertwb pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git.


    from ea32ab9  [BEAM-6284] Improve error message on waitUntilFinish. (#8629)
     add 97edda3  [BEAM-7131] cache executable stage output to prevent re-computation
     add 7775871  Spark portable runner: cache all re-used RDDs by default
     add 65f3c27  refactor to use pushDataset everywhere
     add 05b9dbe  Merge pull request #8558 [BEAM-7131] Spark: cache output to prevent re-computation

No new revisions were added by this update.

Summary of changes:
 .../SparkBatchPortablePipelineTranslator.java      |  94 +++++++++++----
 .../spark/translation/SparkTranslationContext.java |  24 +++-
 .../runners/spark/SparkPortableExecutionTest.java  | 126 +++++++++++++++++++--
 3 files changed, 211 insertions(+), 33 deletions(-)