[jira] [Created] (SPARK-38394) build of spark sql against hadoop-3.4.0-snapshot failing with bouncycastle classpath error

["Steve Loughran (Jira)" <ji...@apache.org>]

Steve Loughran created SPARK-38394:
--------------------------------------

             Summary: build of spark sql against hadoop-3.4.0-snapshot failing with bouncycastle classpath error
                 Key: SPARK-38394
                 URL: https://issues.apache.org/jira/browse/SPARK-38394
             Project: Spark
          Issue Type: Bug
          Components: Build
    Affects Versions: 3.3.0
            Reporter: Steve Loughran


builidng spark master with {{-Dhadoop.version=3.4.0-SNAPSHOT}} and a local hadoop build breaks in the sbt compiler plugin


{code}
[ERROR] Failed to execute goal net.alchim31.maven:scala-maven-plugin:4.3.0:testCompile (scala-test-compile-first) on project spark-sql_2.12: Execution scala-test-compile-first of goal net.alchim31.maven:scala-maven-plugin:4.3.0:testCompile failed: A required class was missing while executing net.alchim31.maven:scala-maven-plugin:4.3.0:testCompile: org/bouncycastle/jce/provider/BouncyCastleProvider
[ERROR] -----------------------------------------------------
[ERROR] realm =    plugin>net.alchim31.maven:scala-maven-plugin:4.3.0

{code}

* this is the classpath of the sbt compiler
* hadoop hasn't been doing anything related to bouncy castle.

setting scala-maven-plugin to 3.4.0 makes this go away, i.e. reapplying SPARK-36547

the implication here is that the plugin version is going to have to be configured in different profiles.






--
This message was sent by Atlassian Jira
(v8.20.1#820001)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org