You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@beam.apache.org by lc...@apache.org on 2019/11/12 00:13:02 UTC

[beam] branch master updated (c7be064 -> e852ac8)

This is an automated email from the ASF dual-hosted git repository.

lcwik pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git.


    from c7be064  Merge pull request #10036 [BEAM-8589] Print pipeline proto and pipeline options in DEBUG loglevel.
     add c32842b  [BEAM-5600, BEAM-2939] Add SplittableParDo expansion logic to runner's core.
     add 45152b8  fixup! Lint
     add 91fd0df  fixup! Fix checkstyle & spotbugs
     add e852ac8  [BEAM-5600, BEAM-2939] Add SplittableParDo expansion logic to runner's core.

No new revisions were added by this update.

Summary of changes:
 .../graph/GreedyPCollectionFusers.java             |  11 +-
 .../core/construction/graph/ProtoOverrides.java    |  26 +-
 .../core/construction/graph/QueryablePipeline.java |   4 +
 .../graph/SplittableParDoExpander.java             | 273 +++++++++++++++++++++
 .../graph/SplittableParDoExpanderTest.java         | 122 +++++++++
 .../beam/runners/flink/FlinkPipelineRunner.java    |  13 +-
 .../beam/runners/samza/SamzaPipelineRunner.java    |  13 +-
 .../beam/runners/spark/SparkPipelineRunner.java    |  13 +-
 .../runners/portability/flink_runner_test.py       |   3 -
 .../runners/portability/portable_runner.py         |   5 +-
 10 files changed, 463 insertions(+), 20 deletions(-)
 create mode 100644 runners/core-construction-java/src/main/java/org/apache/beam/runners/core/construction/graph/SplittableParDoExpander.java
 create mode 100644 runners/core-construction-java/src/test/java/org/apache/beam/runners/core/construction/graph/SplittableParDoExpanderTest.java