You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@beam.apache.org by ec...@apache.org on 2019/02/14 10:38:43 UTC

[beam] branch spark-runner_structured-streaming updated (1576a43 -> 3676b2a)

This is an automated email from the ASF dual-hosted git repository.

echauchot pushed a change to branch spark-runner_structured-streaming
in repository https://gitbox.apache.org/repos/asf/beam.git.


    from 1576a43  Add a test for the most simple possible Combine
     new 7babce7  Rename SparkDoFnFilterFunction to DoFnFilterFunction for consistency
     new 911816d  [BEAM-6663] Add the ability to transform to/from json SerializablePipelineOptions and remove no more needed PipelineOptionsSerializationUtils
     new 3676b2a  Generalize the use of SerializablePipelineOptions in place of (not serializable) PipelineOptions

The 19416 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails.  The revisions
listed as "add" were already present in the repository and have only
been added to this reference.


Summary of changes:
 .../PipelineOptionsSerializationUtils.java         | 47 ----------------------
 .../construction/SerializablePipelineOptions.java  | 37 ++++++++++++++++-
 .../translation/TranslationContext.java            | 11 ++---
 .../translation/batch/DatasetSourceBatch.java      |  6 +--
 .../translation/batch/DoFnFunction.java            |  9 ++---
 .../translation/batch/ParDoTranslatorBatch.java    |  8 ++--
 .../batch/ReadSourceTranslatorBatch.java           |  4 +-
 .../streaming/ReadSourceTranslatorStreaming.java   |  7 +---
 .../translation/batch/SimpleSourceTest.java        |  4 +-
 9 files changed, 55 insertions(+), 78 deletions(-)
 delete mode 100644 runners/core-construction-java/src/main/java/org/apache/beam/runners/core/construction/PipelineOptionsSerializationUtils.java