You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by lc...@apache.org on 2018/07/11 16:37:45 UTC
[beam] branch master updated (21d44a2 -> 5c79a8a)
This is an automated email from the ASF dual-hosted git repository.
lcwik pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git.
from 21d44a2 [BEAM-4764] Fix missing reference to project to be able to refer to the zipTree method.
add 4d62b35 [BEAM-2915] Add support for handling bag user state to the java-fn-execution library to support runner integration.
new 5c79a8a [BEAM-2915] Add support for handling bag user state to the java-fn-execution library to support runner integration.
The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
.gitignore | 2 +-
.../pipeline/src/main/proto/beam_runner_api.proto | 16 +-
.../core/construction/graph/ExecutableStage.java | 23 ++-
.../graph/GreedyPCollectionFusers.java | 4 +
.../core/construction/graph/GreedyStageFuser.java | 8 +-
.../graph/ImmutableExecutableStage.java | 8 +-
.../construction/graph/OutputDeduplicator.java | 1 +
.../core/construction/graph/QueryablePipeline.java | 38 ++++
...InputReference.java => UserStateReference.java} | 58 ++++--
.../construction/graph/ExecutableStageTest.java | 6 +
.../construction/graph/GreedyStageFuserTest.java | 69 +++++++
.../graph/ImmutableExecutableStageTest.java | 5 +
.../construction/graph/OutputDeduplicatorTest.java | 8 +
.../FlinkBatchSideInputHandlerFactoryTest.java | 1 +
runners/java-fn-execution/build.gradle | 1 +
.../control/ProcessBundleDescriptors.java | 80 +++++++-
.../fnexecution/state/StateRequestHandlers.java | 202 ++++++++++++++++++++-
.../fnexecution/control/RemoteExecutionTest.java | 179 +++++++++++++++++-
.../state/StateRequestHandlersTest.java | 63 +++++++
.../java/org/apache/beam/sdk/state/TimeDomain.java | 4 +-
settings.gradle | 2 +
vendor/sdks-java-extensions-protobuf/build.gradle | 77 ++++++++
22 files changed, 816 insertions(+), 39 deletions(-)
copy runners/core-construction-java/src/main/java/org/apache/beam/runners/core/construction/graph/{SideInputReference.java => UserStateReference.java} (51%)
create mode 100644 runners/java-fn-execution/src/test/java/org/apache/beam/runners/fnexecution/state/StateRequestHandlersTest.java
create mode 100644 vendor/sdks-java-extensions-protobuf/build.gradle
[beam] 01/01: [BEAM-2915] Add support for handling bag user state
to the java-fn-execution library to support runner integration.
Posted by lc...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
lcwik pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git
commit 5c79a8ae7079dd9428c5fce7e6decd775f305a31
Merge: 21d44a2 4d62b35
Author: Lukasz Cwik <lc...@google.com>
AuthorDate: Wed Jul 11 09:37:40 2018 -0700
[BEAM-2915] Add support for handling bag user state to the java-fn-execution library to support runner integration.
.gitignore | 2 +-
.../pipeline/src/main/proto/beam_runner_api.proto | 16 +-
.../core/construction/graph/ExecutableStage.java | 23 ++-
.../graph/GreedyPCollectionFusers.java | 4 +
.../core/construction/graph/GreedyStageFuser.java | 8 +-
.../graph/ImmutableExecutableStage.java | 8 +-
.../construction/graph/OutputDeduplicator.java | 1 +
.../core/construction/graph/QueryablePipeline.java | 38 ++++
.../construction/graph/UserStateReference.java | 85 +++++++++
.../construction/graph/ExecutableStageTest.java | 6 +
.../construction/graph/GreedyStageFuserTest.java | 69 +++++++
.../graph/ImmutableExecutableStageTest.java | 5 +
.../construction/graph/OutputDeduplicatorTest.java | 8 +
.../FlinkBatchSideInputHandlerFactoryTest.java | 1 +
runners/java-fn-execution/build.gradle | 1 +
.../control/ProcessBundleDescriptors.java | 80 +++++++-
.../fnexecution/state/StateRequestHandlers.java | 202 ++++++++++++++++++++-
.../fnexecution/control/RemoteExecutionTest.java | 179 +++++++++++++++++-
.../state/StateRequestHandlersTest.java | 63 +++++++
.../java/org/apache/beam/sdk/state/TimeDomain.java | 4 +-
settings.gradle | 2 +
vendor/sdks-java-extensions-protobuf/build.gradle | 77 ++++++++
22 files changed, 860 insertions(+), 22 deletions(-)