You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@beam.apache.org by ie...@apache.org on 2021/04/02 19:29:41 UTC

[beam] branch master updated (2c619c8 -> 1e60f38)

This is an automated email from the ASF dual-hosted git repository.

iemejia pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git.


    from 2c619c8  [BEAM-7372] delete codes for compatibility of py2 from apache_beam/io except for io/gcp (#14352)
     add 9e0b378  [BEAM-11213] Display Beam Metrics in Spark History Server for Classic Runner too
     add 1e60f38  Merge pull request #14409: [BEAM-11213] Display Beam Metrics in Spark History Server for Classic Runner too

No new revisions were added by this update.

Summary of changes:
 .../beam/runners/spark/SparkPipelineOptions.java   | 12 ----
 .../beam/runners/spark/SparkPipelineRunner.java    | 39 ++---------
 .../org/apache/beam/runners/spark/SparkRunner.java | 59 +++++++++++-----
 .../beam/runners/spark/util/SparkCommon.java       | 79 ++++++++++++++++++++++
 .../beam/runners/spark/util/SparkCompat.java       |  6 +-
 .../spark/metrics/SparkMetricsPusherTest.java      |  2 +-
 6 files changed, 131 insertions(+), 66 deletions(-)
 create mode 100644 runners/spark/src/main/java/org/apache/beam/runners/spark/util/SparkCommon.java