You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by ke...@apache.org on 2018/01/17 05:59:30 UTC
[beam] branch master updated (70a520c -> e977cdf)
This is an automated email from the ASF dual-hosted git repository.
kenn pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git.
from 70a520c Merge pull request #4408 from youngoli/beam3126
add 7dabe21 Move DoFnAndMainOutput to top level
add ecde52c Move DoFnSignature helpers to DoFnSignatures and rename
add 6e90e80 Clarify names and visibility of ParDoTranslation helpers
add 32fc290 Make default ParDo output tag explicit
add d70d431 Fix coders in Java SDK harness
add 1c5346f More logging and error checking in ProcessBundleHandler
add a33f0dc Pass portable transform IDs in Dataflow runner
add 8afe0be Correct getAdditionalInputs for Dataflow single-output ParDo override
new e977cdf Merge pull request #4356: [BEAM-2963] Pass portable transform IDs in Dataflow translation
The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
.../core/construction/CombineTranslation.java | 2 +-
.../core/construction/ParDoTranslation.java | 143 ++++++-----------
.../core/construction/PipelineTranslation.java | 8 +-
.../core/construction/RehydratedComponents.java | 9 +-
.../runners/core/construction/SdkComponents.java | 6 +
.../core/construction/WriteFilesTranslation.java | 2 +-
.../core/construction/ParDoTranslationTest.java | 5 +-
runners/google-cloud-dataflow-java/pom.xml | 5 +
.../dataflow/DataflowPipelineTranslator.java | 99 ++++++++----
.../beam/runners/dataflow/DataflowRunner.java | 43 ++++--
.../dataflow/PrimitiveParDoSingleFactory.java | 172 ++++++++++++++++++++-
.../beam/runners/dataflow/TransformTranslator.java | 5 +
.../dataflow/DataflowPipelineTranslatorTest.java | 118 +-------------
.../beam/runners/dataflow/DataflowRunnerTest.java | 125 +++++++++++++++
.../java/org/apache/beam/sdk/transforms/ParDo.java | 5 +-
.../sdk/transforms/reflect/DoFnSignatures.java | 47 ++++++
.../apache/beam/sdk/util/DoFnAndMainOutput.java} | 20 ++-
.../apache/beam/fn/harness/FnApiDoFnRunner.java | 18 +--
.../fn/harness/control/ProcessBundleHandler.java | 18 ++-
19 files changed, 565 insertions(+), 285 deletions(-)
copy sdks/java/{io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/spanner/Transaction.java => core/src/main/java/org/apache/beam/sdk/util/DoFnAndMainOutput.java} (65%)
--
To stop receiving notification emails like this one, please contact
['"commits@beam.apache.org" <co...@beam.apache.org>'].
[beam] 01/01: Merge pull request #4356: [BEAM-2963] Pass portable
transform IDs in Dataflow translation
Posted by ke...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
kenn pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git
commit e977cdff1718b2316115f63903762380c15530de
Merge: 70a520c 8afe0be
Author: Kenn Knowles <ke...@kennknowles.com>
AuthorDate: Tue Jan 16 21:59:22 2018 -0800
Merge pull request #4356: [BEAM-2963] Pass portable transform IDs in Dataflow translation
.../core/construction/CombineTranslation.java | 2 +-
.../core/construction/ParDoTranslation.java | 143 ++++++-----------
.../core/construction/PipelineTranslation.java | 8 +-
.../core/construction/RehydratedComponents.java | 9 +-
.../runners/core/construction/SdkComponents.java | 6 +
.../core/construction/WriteFilesTranslation.java | 2 +-
.../core/construction/ParDoTranslationTest.java | 5 +-
runners/google-cloud-dataflow-java/pom.xml | 5 +
.../dataflow/DataflowPipelineTranslator.java | 99 ++++++++----
.../beam/runners/dataflow/DataflowRunner.java | 43 ++++--
.../dataflow/PrimitiveParDoSingleFactory.java | 172 ++++++++++++++++++++-
.../beam/runners/dataflow/TransformTranslator.java | 5 +
.../dataflow/DataflowPipelineTranslatorTest.java | 118 +-------------
.../beam/runners/dataflow/DataflowRunnerTest.java | 125 +++++++++++++++
.../java/org/apache/beam/sdk/transforms/ParDo.java | 5 +-
.../sdk/transforms/reflect/DoFnSignatures.java | 47 ++++++
.../apache/beam/sdk/util/DoFnAndMainOutput.java | 37 +++++
.../apache/beam/fn/harness/FnApiDoFnRunner.java | 18 +--
.../fn/harness/control/ProcessBundleHandler.java | 18 ++-
19 files changed, 590 insertions(+), 277 deletions(-)
--
To stop receiving notification emails like this one, please contact
"commits@beam.apache.org" <co...@beam.apache.org>.