You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@beam.apache.org by "Beam JIRA Bot (Jira)" <ji...@apache.org> on 2020/09/02 17:08:41 UTC
[jira] [Updated] (BEAM-349) Spark runner should provide a default
BoM
[ https://issues.apache.org/jira/browse/BEAM-349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Beam JIRA Bot updated BEAM-349:
-------------------------------
Priority: P3 (was: P2)
> Spark runner should provide a default BoM
> -----------------------------------------
>
> Key: BEAM-349
> URL: https://issues.apache.org/jira/browse/BEAM-349
> Project: Beam
> Issue Type: Improvement
> Components: runner-spark
> Reporter: Jean-Baptiste Onofré
> Priority: P3
> Labels: stale-P2
>
> When an user defines a pipeline, he has to define the following dependencies in order to work with the Spark runner (in addition of the Spark runner artifact itself):
> {code}
> <dependency>
> <groupId>org.apache.spark</groupId>
> <artifactId>spark-core_2.10</artifactId>
> <version>${spark.version}</version>
> </dependency>
> <dependency>
> <groupId>org.apache.spark</groupId>
> <artifactId>spark-streaming_2.10</artifactId>
> <version>${spark.version}</version>
> </dependency>
> <dependency>
> <groupId>com.fasterxml.jackson.core</groupId>
> <artifactId>jackson-core</artifactId>
> <version>${jackson.version}</version>
> </dependency>
> <dependency>
> <groupId>com.fasterxml.jackson.core</groupId>
> <artifactId>jackson-annotations</artifactId>
> <version>${jackson.version}</version>
> </dependency>
> <dependency>
> <groupId>com.fasterxml.jackson.core</groupId>
> <artifactId>jackson-databind</artifactId>
> <version>${jackson.version}</version>
> </dependency>
> <dependency>
> <groupId>com.fasterxml.jackson.module</groupId>
> <artifactId>jackson-module-scala_2.10</artifactId>
> <version>${jackson.version}</version>
> </dependency>
> {code}
> These dependencies should come as transitive dependencies from the Spark runner (as Flink or dataflow runners do). It means we should change the scope of the dependencies in the Spark runner pom to create a BoM (Bill of Material).
> I will experiment a bit (with [~amitsela]).
--
This message was sent by Atlassian Jira
(v8.3.4#803005)