You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by lc...@apache.org on 2020/06/17 20:28:08 UTC
[beam] branch master updated (c0dd6e7 -> d1c6ef6)
This is an automated email from the ASF dual-hosted git repository.
lcwik pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git.
from c0dd6e7 [BEAM-3489] DataflowRunner to read PubsubMessage if getNeedsMessageId is true (#11873)
add d1c6ef6 [BEAM-10097, BEAM-5982, BEAM-3080] Use primitive views directly instead of transforming KV<Void, Iterable<T>> to the view type via a naive mapping. (#11821)
No new revisions were added by this update.
Summary of changes:
.../apex/translation/ParDoTranslatorTest.java | 2 +-
.../construction/PCollectionViewTranslation.java | 6 -
.../CreatePCollectionViewTranslationTest.java | 57 +-
.../apache/beam/runners/core/SideInputHandler.java | 38 +-
.../beam/runners/core/SideInputHandlerTest.java | 31 +-
.../beam/runners/direct/SideInputContainer.java | 33 +-
.../beam/runners/direct/EvaluationContextTest.java | 9 +-
.../runners/direct/SideInputContainerTest.java | 42 +-
.../functions/FlinkSideInputReader.java | 33 +-
.../functions/SideInputInitializer.java | 69 +-
.../wrappers/streaming/DoFnOperatorTest.java | 37 +-
.../beam/runners/dataflow/DataflowRunner.java | 1 +
.../dataflow/DataflowPipelineTranslatorTest.java | 10 +-
.../beam/runners/dataflow/worker/StateFetcher.java | 48 +-
.../runners/dataflow/worker/StateFetcherTest.java | 14 +-
...tFetchAndFilterStreamingSideInputNodesTest.java | 6 +-
.../fnexecution/control/RemoteExecutionTest.java | 40 +-
.../batch/functions/SparkSideInputReader.java | 102 ++-
.../runners/spark/util/SparkSideInputReader.java | 31 +-
.../org/apache/beam/sdk/transforms/Combine.java | 25 +-
.../org/apache/beam/sdk/transforms/DoFnTester.java | 50 +-
.../java/org/apache/beam/sdk/transforms/View.java | 152 +++-
.../apache/beam/sdk/values/PCollectionViews.java | 880 ++++++++++++++++++++-
.../beam/sdk/testing/PCollectionViewTesting.java | 120 ++-
.../org/apache/beam/sdk/transforms/ViewTest.java | 3 +-
.../beam/sdk/values/PCollectionViewsTest.java | 270 +++++++
.../apache/beam/fn/harness/FnApiDoFnRunner.java | 13 +-
.../beam/fn/harness/state/FnApiStateAccessor.java | 76 +-
...ltimapSideInput.java => IterableSideInput.java} | 47 +-
.../beam/fn/harness/state/SideInputSpec.java | 10 +-
.../beam/fn/harness/FnApiDoFnRunnerTest.java | 50 +-
31 files changed, 1937 insertions(+), 368 deletions(-)
create mode 100644 sdks/java/core/src/test/java/org/apache/beam/sdk/values/PCollectionViewsTest.java
copy sdks/java/harness/src/main/java/org/apache/beam/fn/harness/state/{MultimapSideInput.java => IterableSideInput.java} (62%)