You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by ke...@apache.org on 2017/07/11 03:39:27 UTC

[8/8] beam git commit: This closes #3509: [BEAM-2371] Port DirectRunner overrides to SDK-agnostic APIs

This closes #3509: [BEAM-2371] Port DirectRunner overrides to SDK-agnostic APIs

  Fix null checks in TransformHierarchy
  Fix misleading comment in TransformHierarchy
  Port DirectRunner ParDo overrides to SDK-agnostic APIs
  Enable SplittableParDo on rehydrated ParDo transform
  Include PCollection in rehydrated PCollectionView
  Add more utilities to ParDoTranslation
  Rehydrate PCollections


Project: http://git-wip-us.apache.org/repos/asf/beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/b6b1c8b7
Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/b6b1c8b7
Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/b6b1c8b7

Branch: refs/heads/master
Commit: b6b1c8b7c495df7e9c57a4757b91e4bb2ea82a7c
Parents: c14a318 1518d73
Author: Kenneth Knowles <kl...@google.com>
Authored: Mon Jul 10 20:21:36 2017 -0700
Committer: Kenneth Knowles <kl...@google.com>
Committed: Mon Jul 10 20:21:36 2017 -0700

----------------------------------------------------------------------
 .../construction/PCollectionTranslation.java    |  16 +++
 .../core/construction/ParDoTranslation.java     | 103 ++++++++++++++++++-
 .../construction/RunnerPCollectionView.java     |  23 ++++-
 .../core/construction/SplittableParDo.java      |  25 +++++
 .../PCollectionTranslationTest.java             |  22 ++++
 .../core/construction/ParDoTranslationTest.java |  28 +++--
 .../direct/ParDoMultiOverrideFactory.java       |  47 +++++----
 .../flink/FlinkStreamingPipelineTranslator.java |   2 +-
 .../beam/sdk/runners/TransformHierarchy.java    |  12 +--
 9 files changed, 232 insertions(+), 46 deletions(-)
----------------------------------------------------------------------