You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by lc...@apache.org on 2020/06/17 20:28:08 UTC

[beam] branch master updated (c0dd6e7 -> d1c6ef6)

This is an automated email from the ASF dual-hosted git repository.

lcwik pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git.


    from c0dd6e7  [BEAM-3489] DataflowRunner to read PubsubMessage if getNeedsMessageId is true (#11873)
     add d1c6ef6  [BEAM-10097, BEAM-5982, BEAM-3080] Use primitive views directly instead of transforming KV<Void, Iterable<T>> to the view type via a naive mapping. (#11821)

No new revisions were added by this update.

Summary of changes:
 .../apex/translation/ParDoTranslatorTest.java      |   2 +-
 .../construction/PCollectionViewTranslation.java   |   6 -
 .../CreatePCollectionViewTranslationTest.java      |  57 +-
 .../apache/beam/runners/core/SideInputHandler.java |  38 +-
 .../beam/runners/core/SideInputHandlerTest.java    |  31 +-
 .../beam/runners/direct/SideInputContainer.java    |  33 +-
 .../beam/runners/direct/EvaluationContextTest.java |   9 +-
 .../runners/direct/SideInputContainerTest.java     |  42 +-
 .../functions/FlinkSideInputReader.java            |  33 +-
 .../functions/SideInputInitializer.java            |  69 +-
 .../wrappers/streaming/DoFnOperatorTest.java       |  37 +-
 .../beam/runners/dataflow/DataflowRunner.java      |   1 +
 .../dataflow/DataflowPipelineTranslatorTest.java   |  10 +-
 .../beam/runners/dataflow/worker/StateFetcher.java |  48 +-
 .../runners/dataflow/worker/StateFetcherTest.java  |  14 +-
 ...tFetchAndFilterStreamingSideInputNodesTest.java |   6 +-
 .../fnexecution/control/RemoteExecutionTest.java   |  40 +-
 .../batch/functions/SparkSideInputReader.java      | 102 ++-
 .../runners/spark/util/SparkSideInputReader.java   |  31 +-
 .../org/apache/beam/sdk/transforms/Combine.java    |  25 +-
 .../org/apache/beam/sdk/transforms/DoFnTester.java |  50 +-
 .../java/org/apache/beam/sdk/transforms/View.java  | 152 +++-
 .../apache/beam/sdk/values/PCollectionViews.java   | 880 ++++++++++++++++++++-
 .../beam/sdk/testing/PCollectionViewTesting.java   | 120 ++-
 .../org/apache/beam/sdk/transforms/ViewTest.java   |   3 +-
 .../beam/sdk/values/PCollectionViewsTest.java      | 270 +++++++
 .../apache/beam/fn/harness/FnApiDoFnRunner.java    |  13 +-
 .../beam/fn/harness/state/FnApiStateAccessor.java  |  76 +-
 ...ltimapSideInput.java => IterableSideInput.java} |  47 +-
 .../beam/fn/harness/state/SideInputSpec.java       |  10 +-
 .../beam/fn/harness/FnApiDoFnRunnerTest.java       |  50 +-
 31 files changed, 1937 insertions(+), 368 deletions(-)
 create mode 100644 sdks/java/core/src/test/java/org/apache/beam/sdk/values/PCollectionViewsTest.java
 copy sdks/java/harness/src/main/java/org/apache/beam/fn/harness/state/{MultimapSideInput.java => IterableSideInput.java} (62%)