You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by ke...@apache.org on 2016/12/21 22:49:56 UTC
[22/51] [abbrv] incubator-beam git commit: This closes #1581:
[BEAM-1117] Port direct runner StatefulParDo to KeyedWorkItem
This closes #1581: [BEAM-1117] Port direct runner StatefulParDo to KeyedWorkItem
Port direct runner StatefulParDo to KeyedWorkItem
Propagate key through ParDo if DoFn is key-preserving
Move responsibility for knowing about keyedness into EvaluationContext
Add some key-preserving to KeyedPValueTrackingVisitor
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/2f4b8031
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/2f4b8031
Diff: http://git-wip-us.apache.org/repos/asf/incubator-beam/diff/2f4b8031
Branch: refs/heads/python-sdk
Commit: 2f4b80312c69da00df82aaa37d17cc2f6a742648
Parents: a526adb 1f018ab
Author: Kenneth Knowles <kl...@google.com>
Authored: Tue Dec 20 12:39:34 2016 -0800
Committer: Kenneth Knowles <kl...@google.com>
Committed: Tue Dec 20 12:39:34 2016 -0800
----------------------------------------------------------------------
.../beam/runners/direct/DirectRunner.java | 13 +-
.../beam/runners/direct/EvaluationContext.java | 26 +++-
.../direct/ExecutorServiceParallelExecutor.java | 8 +-
.../direct/KeyedPValueTrackingVisitor.java | 44 ++++--
.../beam/runners/direct/ParDoEvaluator.java | 13 +-
.../runners/direct/ParDoEvaluatorFactory.java | 3 +
.../direct/ParDoMultiOverrideFactory.java | 94 +++++++++++--
...littableProcessElementsEvaluatorFactory.java | 1 +
.../direct/StatefulParDoEvaluatorFactory.java | 36 ++---
.../runners/direct/EvaluationContextTest.java | 9 +-
.../direct/KeyedPValueTrackingVisitorTest.java | 135 +++++++++----------
.../beam/runners/direct/ParDoEvaluatorTest.java | 1 +
.../StatefulParDoEvaluatorFactoryTest.java | 51 ++++---
13 files changed, 281 insertions(+), 153 deletions(-)
----------------------------------------------------------------------