You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2020/09/24 15:34:00 UTC

[jira] [Resolved] (SPARK-32954) Add jakarta.servlet-api test dependency to yarn module to avoid classpath badcase of UTs

     [ https://issues.apache.org/jira/browse/SPARK-32954?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Dongjoon Hyun resolved SPARK-32954.
-----------------------------------
    Fix Version/s: 3.1.0
       Resolution: Fixed

Issue resolved by pull request 29824
[https://github.com/apache/spark/pull/29824]

> Add jakarta.servlet-api test dependency to yarn module to avoid classpath badcase of UTs
> ----------------------------------------------------------------------------------------
>
>                 Key: SPARK-32954
>                 URL: https://issues.apache.org/jira/browse/SPARK-32954
>             Project: Spark
>          Issue Type: Improvement
>          Components: YARN
>    Affects Versions: 3.1.0
>            Reporter: Yang Jie
>            Assignee: Yang Jie
>            Priority: Minor
>             Fix For: 3.1.0
>
>
> When I tried to verify that the resource-managers yarn module passed all UTs in Scala 2.13 , I found that there are a classpath dependent badcase blocking the test because there are more than one `servlet-api` dependency in spark now:
>  * one is `javax.servlet:javax.servlet-api:3.10:compile` we config in core/pom.xml,
>  * the other is `jakarta.servlet:jakarta.servlet-api:4.0.3:test`  cascaded by `org.glassfish.jersey.test-framework.providers`, we can use `mvn dependency:tree` to check it .
> So when we execute resource-managers yarn module test use
> mvn clean test -pl resource-managers/yarn -Pyarn 
> or 
> mvn clean test -pl resource-managers/yarn -Pyarn -Pscala-2.13
>  
> if the position of `javax.servlet-api` in the  in classpath is before `jakarta.servlet-api`, there are some cases failed in YarnClusterSuite, YarnShuffleIntegrationSuite  and YarnShuffleAuthSuite.
>  
> The failed reason as follow:
>  
> {code:java}
> 20/09/18 19:14:07.486 launcher-proc-1 INFO YarnClusterDriver: Exception in thread "main" java.lang.ExceptionInInitializerError
> ...
> 20/09/18 19:14:07.486 launcher-proc-1 INFO YarnClusterDriver: Caused by: java.lang.SecurityException: class "javax.servlet.http.HttpSessionIdListener"'s signer information does not match signer information of other classes in the same package
> ...{code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org