[beam] branch spark-runner_structured-streaming updated (ff7a24f -> bac8773)

[ec...@apache.org]

This is an automated email from the ASF dual-hosted git repository.

echauchot pushed a change to branch spark-runner_structured-streaming
in repository https://gitbox.apache.org/repos/asf/beam.git.


    from ff7a24f  Fail in case of having SideInouts or State/Timers
     new bdf36e5  Fix Encoders: create an Encoder for every manipulated type to avoid Spark fallback to genericRowWithSchema and cast to allow having Encoders with generic types such as WindowedValue<T> and get the type checking back
     new bac8773  Apply spotless

The 19403 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails.  The revisions
listed as "add" were already present in the repository and have only
been added to this reference.


Summary of changes:
 .../structuredstreaming/SparkPipelineOptions.java  |  1 -
 .../translation/EncoderHelpers.java                | 30 +++++++++-
 .../translation/TranslationContext.java            |  6 +-
 .../translation/batch/DatasetSourceBatch.java      | 51 ++++++++--------
 .../translation/batch/DoFnFunction.java            | 11 ++--
 .../batch/GroupByKeyTranslatorBatch.java           |  8 +--
 .../translation/batch/ParDoTranslatorBatch.java    | 31 +++++-----
 .../translation/batch/PipelineTranslatorBatch.java |  4 +-
 .../translation/batch/ProcessContext.java          |  8 +--
 .../batch/ReadSourceTranslatorBatch.java           | 47 +++++++++------
 .../batch/functions/SparkSideInputReader.java      | 16 ++----
 .../streaming/DatasetSourceStreaming.java          | 31 ++++++----
 .../streaming/PipelineTranslatorStreaming.java     |  4 +-
 .../streaming/ReadSourceTranslatorStreaming.java   | 51 +++++++++-------
 .../translation/batch/ComplexSourceTest.java       | 30 ++++++++--
 .../translation/batch/FlattenTest.java             | 27 ++++++---
 .../translation/batch/GroupByKeyTest.java          | 33 ++++++++---
 .../translation/batch/ParDoTest.java               | 40 +++++++++----
 .../translation/batch/SimpleSourceTest.java        | 67 ++++++++++++++--------
 .../utils/SerializationDebugger.java               | 35 +++--------
 20 files changed, 319 insertions(+), 212 deletions(-)