You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by re...@apache.org on 2018/04/25 16:23:16 UTC
[beam] branch master updated (7a48f62 -> 82a0ae3)
This is an automated email from the ASF dual-hosted git repository.
reuvenlax pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git.
from 7a48f62 Merge pull request #5206 from szewi/spark-fix
add b464aaf Add support for @Element injection in NewDoFn.
add 8116e08 Add @Timestamp annotation to NewDoFn
add 11127d5 Add support for OutputReceiver and MultiOutputReceiver. Currently we only support this in processElement and processTimer.
add 209dd83 Add support for timestamp and time domain to timers. Convert word count example to use new argument style.
add dc74246 Add some more tests.
add 6a6f62c Rewrite MapElements to use new-style.
add 71ea425 Port common transforms to new style, excluding those that use functionality not yet supported (such as side inputs).
add f553a92 Fix javadoc.
add ef68b98 Fix compilation error.
add f95af12 Fix CheckStyle errors.
add 7950e3d Add proper downcast for element type.
add e82a4f6 Fix CheckStyle error.
add 396b9ba Change MultiOutputReceiver to vend OutputReceivers.
add d1b7a52 Fix ParDoTest
add e7163d5 Fix DoFnTester
add 16bf45a Address CR comments.
add 3da3594 Don't allow splitting a restriction into a different timestamp.
add b49ca41 Add @Nullable annotations to DoFnTester.
add e62d997 Usage of the new parameters will break on Dataflow until Dataflow's worker image has been rebuilt with the new interface. Remove these usages for now, and will add back as soon as Dataflow has rebuilt its worker image.
new 82a0ae3 Merge pull request #4989: [BEAM-3979] Start completing the new DoFn vision: plumb context parameters into process functions.
The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
.../runners/core/construction/SplittableParDo.java | 14 +-
...TimeBoundedSplittableProcessElementInvoker.java | 37 ++
.../apache/beam/runners/core/SimpleDoFnRunner.java | 139 +++++++
.../java/org/apache/beam/sdk/transforms/DoFn.java | 46 ++-
.../beam/sdk/transforms/DoFnOutputReceivers.java | 84 ++++
.../org/apache/beam/sdk/transforms/DoFnTester.java | 68 ++++
.../java/org/apache/beam/sdk/transforms/ParDo.java | 23 +-
.../reflect/ByteBuddyDoFnInvokerFactory.java | 68 +++-
.../beam/sdk/transforms/reflect/DoFnInvoker.java | 79 ++++
.../beam/sdk/transforms/reflect/DoFnSignature.java | 150 +++++++-
.../sdk/transforms/reflect/DoFnSignatures.java | 63 ++-
.../org/apache/beam/sdk/transforms/ParDoTest.java | 421 ++++++++++++---------
.../sdk/transforms/reflect/DoFnInvokersTest.java | 58 ++-
.../sdk/transforms/reflect/DoFnSignaturesTest.java | 109 +++++-
.../apache/beam/fn/harness/FnApiDoFnRunner.java | 104 +++++
15 files changed, 1254 insertions(+), 209 deletions(-)
create mode 100644 sdks/java/core/src/main/java/org/apache/beam/sdk/transforms/DoFnOutputReceivers.java
--
To stop receiving notification emails like this one, please contact
reuvenlax@apache.org.
[beam] 01/01: Merge pull request #4989: [BEAM-3979] Start
completing the new DoFn vision: plumb context parameters into process
functions.
Posted by re...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
reuvenlax pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git
commit 82a0ae385803ca0d12b85a302d13eb68361a1cda
Merge: 7a48f62 e62d997
Author: reuvenlax <re...@google.com>
AuthorDate: Wed Apr 25 09:23:09 2018 -0700
Merge pull request #4989: [BEAM-3979] Start completing the new DoFn vision: plumb context parameters into process functions.
.../runners/core/construction/SplittableParDo.java | 14 +-
...TimeBoundedSplittableProcessElementInvoker.java | 37 ++
.../apache/beam/runners/core/SimpleDoFnRunner.java | 139 +++++++
.../java/org/apache/beam/sdk/transforms/DoFn.java | 46 ++-
.../beam/sdk/transforms/DoFnOutputReceivers.java | 84 ++++
.../org/apache/beam/sdk/transforms/DoFnTester.java | 68 ++++
.../java/org/apache/beam/sdk/transforms/ParDo.java | 23 +-
.../reflect/ByteBuddyDoFnInvokerFactory.java | 68 +++-
.../beam/sdk/transforms/reflect/DoFnInvoker.java | 79 ++++
.../beam/sdk/transforms/reflect/DoFnSignature.java | 150 +++++++-
.../sdk/transforms/reflect/DoFnSignatures.java | 63 ++-
.../org/apache/beam/sdk/transforms/ParDoTest.java | 421 ++++++++++++---------
.../sdk/transforms/reflect/DoFnInvokersTest.java | 58 ++-
.../sdk/transforms/reflect/DoFnSignaturesTest.java | 109 +++++-
.../apache/beam/fn/harness/FnApiDoFnRunner.java | 104 +++++
15 files changed, 1254 insertions(+), 209 deletions(-)
--
To stop receiving notification emails like this one, please contact
reuvenlax@apache.org.