[jira] [Updated] (BEAM-7092) Update Spark runner tests to validate different versions of Spark/Scala

["Ismaël Mejía (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/BEAM-7092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Ismaël Mejía updated BEAM-7092:
-------------------------------
    Summary: Update Spark runner tests to validate different versions of Spark/Scala  (was: Update Spark runner support multiple versions of Spark/Scala)

> Update Spark runner tests to validate different versions of Spark/Scala
> -----------------------------------------------------------------------
>
>                 Key: BEAM-7092
>                 URL: https://issues.apache.org/jira/browse/BEAM-7092
>             Project: Beam
>          Issue Type: Sub-task
>          Components: runner-spark
>            Reporter: Ismaël Mejía
>            Assignee: Ismaël Mejía
>            Priority: Minor
>
> Since Spark 3 is relying on Scala 2.12 and a different set of dependencies probably we need to divide the project and reuse most of the code as the Flink runner does to support multiple major versions. (Notice that minor versions are provided in the case of the Spark runner).
> Probably the best (and simplest) path forward is to continue with Scala 2.11 as the default for the current runner (based on Spark 2). And make the Scala 2.12 set of dependencies the default for Spark 3.



--
This message was sent by Atlassian JIRA
(v7.6.14#76016)