You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by ie...@apache.org on 2019/05/29 09:37:55 UTC

[beam] branch master updated (23115ce -> cd8c6ec)

This is an automated email from the ASF dual-hosted git repository.

iemejia pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git.


    from 23115ce  [cleanup] Remove unncecessary Flink timestamp from UnboundedSourceWrapper
     add 9fc25de  Remove unused Accumulator in SparkGroupAlsoByWindowViaOutputBufferFn
     add fa96678  [BEAM-7448] Remove unneeded external windowedValue in collections for window merging as the windowedValue is already with the elements. Clean related functions and avoid calling so mappers.
     new cd8c6ec  Merge pull request #8711: [BEAM-7448] Remove redundant windowing information and unused accumulators on Spark runner

The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails.  The revisions
listed as "add" were already present in the repository and have only
been added to this reference.


Summary of changes:
 .../spark/stateful/SparkGroupAlsoByWindowViaWindowSet.java |  9 +++------
 .../runners/spark/translation/GroupCombineFunctions.java   |  6 ++----
 .../translation/SparkBatchPortablePipelineTranslator.java  |  6 ++----
 .../SparkGroupAlsoByWindowViaOutputBufferFn.java           | 13 +++++--------
 .../runners/spark/translation/TransformTranslator.java     | 14 +++++---------
 .../streaming/StreamingTransformTranslator.java            |  2 +-
 6 files changed, 18 insertions(+), 32 deletions(-)


[beam] 01/01: Merge pull request #8711: [BEAM-7448] Remove redundant windowing information and unused accumulators on Spark runner

Posted by ie...@apache.org.
This is an automated email from the ASF dual-hosted git repository.

iemejia pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git

commit cd8c6ec57c92baf5088ab52fa5b9f77d211ba40b
Merge: 23115ce fa96678
Author: Ismaël Mejía <ie...@gmail.com>
AuthorDate: Wed May 29 11:37:34 2019 +0200

    Merge pull request #8711: [BEAM-7448] Remove redundant windowing information and unused accumulators on Spark runner

 .../spark/stateful/SparkGroupAlsoByWindowViaWindowSet.java |  9 +++------
 .../runners/spark/translation/GroupCombineFunctions.java   |  6 ++----
 .../translation/SparkBatchPortablePipelineTranslator.java  |  6 ++----
 .../SparkGroupAlsoByWindowViaOutputBufferFn.java           | 13 +++++--------
 .../runners/spark/translation/TransformTranslator.java     | 14 +++++---------
 .../streaming/StreamingTransformTranslator.java            |  2 +-
 6 files changed, 18 insertions(+), 32 deletions(-)