You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Apache Spark (Jira)" <ji...@apache.org> on 2020/09/21 15:51:00 UTC
[jira] [Commented] (SPARK-32954) Add jakarta.servlet-api test
dependency to yarn module to avoid classpath badcase of UTs
[ https://issues.apache.org/jira/browse/SPARK-32954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17199470#comment-17199470 ]
Apache Spark commented on SPARK-32954:
--------------------------------------
User 'LuciferYang' has created a pull request for this issue:
https://github.com/apache/spark/pull/29824
> Add jakarta.servlet-api test dependency to yarn module to avoid classpath badcase of UTs
> ----------------------------------------------------------------------------------------
>
> Key: SPARK-32954
> URL: https://issues.apache.org/jira/browse/SPARK-32954
> Project: Spark
> Issue Type: Improvement
> Components: YARN
> Affects Versions: 3.1.0
> Reporter: Yang Jie
> Priority: Minor
>
> When I tried to verify that the resource-managers yarn module passed all UTs in Scala 2.13 , I found that there are a classpath dependent badcase blocking the test because there are more than one `servlet-api` dependency in spark now:
> * one is `javax.servlet:javax.servlet-api:3.10:compile` we config in core/pom.xml,
> * the other is `jakarta.servlet:jakarta.servlet-api:4.0.3:test` cascaded by `org.glassfish.jersey.test-framework.providers`, we can use `mvn dependency:tree` to check it .
> So when we execute resource-managers yarn module test use
> mvn clean test -pl resource-managers/yarn -Pyarn
> or
> mvn clean test -pl resource-managers/yarn -Pyarn -Pscala-2.13
>
> if the position of `javax.servlet-api` in the in classpath is before `jakarta.servlet-api`, there are some cases failed in YarnClusterSuite, YarnShuffleIntegrationSuite and YarnShuffleAuthSuite.
>
> The failed reason as follow:
>
> {code:java}
> 20/09/18 19:14:07.486 launcher-proc-1 INFO YarnClusterDriver: Exception in thread "main" java.lang.ExceptionInInitializerError
> ...
> 20/09/18 19:14:07.486 launcher-proc-1 INFO YarnClusterDriver: Caused by: java.lang.SecurityException: class "javax.servlet.http.HttpSessionIdListener"'s signer information does not match signer information of other classes in the same package
> ...{code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org