You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by re...@apache.org on 2020/08/08 20:29:56 UTC
[beam] branch master updated (7fbc09e -> edb4295)
This is an automated email from the ASF dual-hosted git repository.
reuvenlax pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git.
from 7fbc09e Merge pull request #11749 from boyuanzz/kafka
add 9d0d0b0 OrderedListState API
new edb4295 Merge pull request #12474: [BEAM-10650] OrderedListState API
The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
.../pipeline/src/main/proto/beam_runner_api.proto | 5 +
.../core/construction/ParDoTranslation.java | 9 ++
.../beam/runners/core/InMemoryStateInternals.java | 100 ++++++++++++-
.../org/apache/beam/runners/core/StateTag.java | 3 +
.../org/apache/beam/runners/core/StateTags.java | 11 ++
.../direct/CopyOnAccessInMemoryStateInternals.java | 22 +++
runners/flink/flink_runner.gradle | 1 +
runners/flink/job-server/flink_job_server.gradle | 2 +
.../state/FlinkBroadcastStateInternals.java | 8 +
.../streaming/state/FlinkStateInternals.java | 15 ++
runners/google-cloud-dataflow-java/build.gradle | 1 +
.../beam/runners/dataflow/DataflowRunner.java | 7 +
.../dataflow/worker/WindmillStateInternals.java | 93 +++++++++++-
.../worker/windmill/src/main/proto/windmill.proto | 59 ++++++++
runners/jet/build.gradle | 1 +
runners/portability/java/build.gradle | 1 +
runners/samza/build.gradle | 1 +
.../samza/runtime/SamzaStoreStateInternals.java | 8 +
runners/spark/build.gradle | 2 +
runners/spark/job-server/build.gradle | 1 +
.../spark/stateful/SparkStateInternals.java | 8 +
.../apache/beam/sdk/state/OrderedListState.java | 55 +++++++
.../org/apache/beam/sdk/state/StateBinder.java | 3 +
.../StateKeySpec.java} | 22 +--
.../java/org/apache/beam/sdk/state/StateSpec.java | 2 +
.../java/org/apache/beam/sdk/state/StateSpecs.java | 64 ++++++++
...{UsesImpulse.java => UsesOrderedListState.java} | 5 +-
.../java/org/apache/beam/sdk/transforms/ParDo.java | 5 +
.../sdk/transforms/reflect/DoFnSignatures.java | 5 +
.../org/apache/beam/sdk/transforms/ParDoTest.java | 166 +++++++++++++++++++++
.../beam/fn/harness/state/FnApiStateAccessor.java | 8 +
31 files changed, 678 insertions(+), 15 deletions(-)
create mode 100644 sdks/java/core/src/main/java/org/apache/beam/sdk/state/OrderedListState.java
copy sdks/java/core/src/main/java/org/apache/beam/sdk/{schemas/io/InvalidConfigurationException.java => state/StateKeySpec.java} (63%)
copy sdks/java/core/src/main/java/org/apache/beam/sdk/testing/{UsesImpulse.java => UsesOrderedListState.java} (84%)
[beam] 01/01: Merge pull request #12474: [BEAM-10650]
OrderedListState API
Posted by re...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
reuvenlax pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git
commit edb42952f6b0aa99477f5c7baca6d6a0d93deb4f
Merge: 7fbc09e 9d0d0b0
Author: reuvenlax <re...@google.com>
AuthorDate: Sat Aug 8 13:29:31 2020 -0700
Merge pull request #12474: [BEAM-10650] OrderedListState API
.../pipeline/src/main/proto/beam_runner_api.proto | 5 +
.../core/construction/ParDoTranslation.java | 9 ++
.../beam/runners/core/InMemoryStateInternals.java | 100 ++++++++++++-
.../org/apache/beam/runners/core/StateTag.java | 3 +
.../org/apache/beam/runners/core/StateTags.java | 11 ++
.../direct/CopyOnAccessInMemoryStateInternals.java | 22 +++
runners/flink/flink_runner.gradle | 1 +
runners/flink/job-server/flink_job_server.gradle | 2 +
.../state/FlinkBroadcastStateInternals.java | 8 +
.../streaming/state/FlinkStateInternals.java | 15 ++
runners/google-cloud-dataflow-java/build.gradle | 1 +
.../beam/runners/dataflow/DataflowRunner.java | 7 +
.../dataflow/worker/WindmillStateInternals.java | 93 +++++++++++-
.../worker/windmill/src/main/proto/windmill.proto | 59 ++++++++
runners/jet/build.gradle | 1 +
runners/portability/java/build.gradle | 1 +
runners/samza/build.gradle | 1 +
.../samza/runtime/SamzaStoreStateInternals.java | 8 +
runners/spark/build.gradle | 2 +
runners/spark/job-server/build.gradle | 1 +
.../spark/stateful/SparkStateInternals.java | 8 +
.../apache/beam/sdk/state/OrderedListState.java | 55 +++++++
.../org/apache/beam/sdk/state/StateBinder.java | 3 +
.../org/apache/beam/sdk/state/StateKeySpec.java | 39 +++++
.../java/org/apache/beam/sdk/state/StateSpec.java | 2 +
.../java/org/apache/beam/sdk/state/StateSpecs.java | 64 ++++++++
.../beam/sdk/testing/UsesOrderedListState.java | 25 ++++
.../java/org/apache/beam/sdk/transforms/ParDo.java | 5 +
.../sdk/transforms/reflect/DoFnSignatures.java | 5 +
.../org/apache/beam/sdk/transforms/ParDoTest.java | 166 +++++++++++++++++++++
.../beam/fn/harness/state/FnApiStateAccessor.java | 8 +
31 files changed, 728 insertions(+), 2 deletions(-)