You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by ke...@apache.org on 2022/09/30 21:12:46 UTC
[beam] branch master updated (12785495923 -> 3c7a4e0f44d)
This is an automated email from the ASF dual-hosted git repository.
kenn pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git
from 12785495923 Fix type inference for set/delete attr. (#23242)
add 3c7a4e0f44d Support VR test including TestStream for Spark runner in streaming mode (#22620)
No new revisions were added by this update.
Summary of changes:
runners/spark/spark_runner.gradle | 60 +++++++--
.../org/apache/beam/runners/spark/SparkRunner.java | 6 +-
.../apache/beam/runners/spark/TestSparkRunner.java | 6 +-
.../streaming/StreamingTransformTranslator.java | 26 +++-
.../spark/translation/streaming/TestDStream.java | 142 +++++++++++++++++++++
.../runners/spark/SparkRunnerDebuggerTest.java | 2 +-
.../metrics/sink/SparkMetricsSinkTest.java | 2 +-
.../spark/metrics/SparkMetricsPusherTest.java | 2 +-
.../translation/streaming/CreateStreamTest.java | 2 +-
.../ResumeFromCheckpointStreamingTest.java | 2 +-
.../streaming/SparkCoGroupByKeyStreamingTest.java | 2 +-
.../streaming/StreamingSourceMetricsTest.java | 2 +-
.../apache/beam/sdk/testing/TestStreamTest.java | 3 +
13 files changed, 233 insertions(+), 24 deletions(-)
create mode 100644 runners/spark/src/main/java/org/apache/beam/runners/spark/translation/streaming/TestDStream.java