[GitHub] [beam] damccorm opened a new issue, #17899: Spark runner should provide a default BoM

[GitBox <gi...@apache.org>]

damccorm opened a new issue, #17899:
URL: https://github.com/apache/beam/issues/17899

   When an user defines a pipeline, he has to define the following dependencies in order to work with the Spark runner (in addition of the Spark runner artifact itself):
   
   ```
   
     <dependency>
                       <groupId>org.apache.spark</groupId>
                       <artifactId>spark-core_2.10</artifactId>
   
                      <version>${spark.version}</version>
                   </dependency>
                 
    <dependency>
                       <groupId>org.apache.spark</groupId>
                       <artifactId>spark-streaming_2.10</artifactId>
   
                      <version>${spark.version}</version>
                   </dependency>
                 
    <dependency>
                       <groupId>com.fasterxml.jackson.core</groupId>
                      
   <artifactId>jackson-core</artifactId>
                       <version>${jackson.version}</version>
      
               </dependency>
                   <dependency>
                       <groupId>com.fasterxml.jackson.core</groupId>
   
                      <artifactId>jackson-annotations</artifactId>
                       <version>${jackson.version}</version>
   
                  </dependency>
                   <dependency>
                       <groupId>com.fasterxml.jackson.core</groupId>
   
                      <artifactId>jackson-databind</artifactId>
                       <version>${jackson.version}</version>
   
                  </dependency>
                   <dependency>
                       <groupId>com.fasterxml.jackson.module</groupId>
   
                      <artifactId>jackson-module-scala_2.10</artifactId>
                       <version>${jackson.version}</version>
   
                  </dependency>
   
   ```
   
   
   These dependencies should come as transitive dependencies from the Spark runner (as Flink or dataflow runners do). It means we should change the scope of the dependencies in the Spark runner pom to create a BoM (Bill of Material).
   
   I will experiment a bit (with [~amitsela]).
   
   Imported from Jira [BEAM-349](https://issues.apache.org/jira/browse/BEAM-349). Original Jira may contain additional context.
   Reported by: jbonofre.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [beam] damccorm closed issue #17899: Spark runner should provide a default BoM

[GitBox <gi...@apache.org>]

damccorm closed issue #17899: Spark runner should provide a default BoM
URL: https://github.com/apache/beam/issues/17899


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org