You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Apache Spark (Jira)" <ji...@apache.org> on 2022/03/03 18:33:00 UTC
[jira] [Assigned] (SPARK-38394) build of spark sql against hadoop-3.4.0-snapshot failing with bouncycastle classpath error
[ https://issues.apache.org/jira/browse/SPARK-38394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Apache Spark reassigned SPARK-38394:
------------------------------------
Assignee: (was: Apache Spark)
> build of spark sql against hadoop-3.4.0-snapshot failing with bouncycastle classpath error
> ------------------------------------------------------------------------------------------
>
> Key: SPARK-38394
> URL: https://issues.apache.org/jira/browse/SPARK-38394
> Project: Spark
> Issue Type: Bug
> Components: Build
> Affects Versions: 3.3.0
> Reporter: Steve Loughran
> Priority: Minor
>
> builidng spark master with {{-Dhadoop.version=3.4.0-SNAPSHOT}} and a local hadoop build breaks in the sbt compiler plugin
> {code}
> [ERROR] Failed to execute goal net.alchim31.maven:scala-maven-plugin:4.3.0:testCompile (scala-test-compile-first) on project spark-sql_2.12: Execution scala-test-compile-first of goal net.alchim31.maven:scala-maven-plugin:4.3.0:testCompile failed: A required class was missing while executing net.alchim31.maven:scala-maven-plugin:4.3.0:testCompile: org/bouncycastle/jce/provider/BouncyCastleProvider
> [ERROR] -----------------------------------------------------
> [ERROR] realm = plugin>net.alchim31.maven:scala-maven-plugin:4.3.0
> {code}
> * this is the classpath of the sbt compiler
> * hadoop hasn't been doing anything related to bouncy castle.
> setting scala-maven-plugin to 3.4.0 makes this go away, i.e. reapplying SPARK-36547
> the implication here is that the plugin version is going to have to be configured in different profiles.
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org