You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by ke...@apache.org on 2018/01/17 05:59:31 UTC
[beam] 01/01: Merge pull request #4356: [BEAM-2963] Pass portable
transform IDs in Dataflow translation
This is an automated email from the ASF dual-hosted git repository.
kenn pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git
commit e977cdff1718b2316115f63903762380c15530de
Merge: 70a520c 8afe0be
Author: Kenn Knowles <ke...@kennknowles.com>
AuthorDate: Tue Jan 16 21:59:22 2018 -0800
Merge pull request #4356: [BEAM-2963] Pass portable transform IDs in Dataflow translation
.../core/construction/CombineTranslation.java | 2 +-
.../core/construction/ParDoTranslation.java | 143 ++++++-----------
.../core/construction/PipelineTranslation.java | 8 +-
.../core/construction/RehydratedComponents.java | 9 +-
.../runners/core/construction/SdkComponents.java | 6 +
.../core/construction/WriteFilesTranslation.java | 2 +-
.../core/construction/ParDoTranslationTest.java | 5 +-
runners/google-cloud-dataflow-java/pom.xml | 5 +
.../dataflow/DataflowPipelineTranslator.java | 99 ++++++++----
.../beam/runners/dataflow/DataflowRunner.java | 43 ++++--
.../dataflow/PrimitiveParDoSingleFactory.java | 172 ++++++++++++++++++++-
.../beam/runners/dataflow/TransformTranslator.java | 5 +
.../dataflow/DataflowPipelineTranslatorTest.java | 118 +-------------
.../beam/runners/dataflow/DataflowRunnerTest.java | 125 +++++++++++++++
.../java/org/apache/beam/sdk/transforms/ParDo.java | 5 +-
.../sdk/transforms/reflect/DoFnSignatures.java | 47 ++++++
.../apache/beam/sdk/util/DoFnAndMainOutput.java | 37 +++++
.../apache/beam/fn/harness/FnApiDoFnRunner.java | 18 +--
.../fn/harness/control/ProcessBundleHandler.java | 18 ++-
19 files changed, 590 insertions(+), 277 deletions(-)
--
To stop receiving notification emails like this one, please contact
"commits@beam.apache.org" <co...@beam.apache.org>.