You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Yang Jie (Jira)" <ji...@apache.org> on 2020/09/21 15:31:00 UTC
[jira] [Updated] (SPARK-32954) Add jakarta.servlet-api test
dependency to resource-managers yarn module to avoid badcase of UTs
[ https://issues.apache.org/jira/browse/SPARK-32954?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Yang Jie updated SPARK-32954:
-----------------------------
Summary: Add jakarta.servlet-api test dependency to resource-managers yarn module to avoid badcase of UTs (was: Add jakarta.servlet-api test dependency to )
> Add jakarta.servlet-api test dependency to resource-managers yarn module to avoid badcase of UTs
> ------------------------------------------------------------------------------------------------
>
> Key: SPARK-32954
> URL: https://issues.apache.org/jira/browse/SPARK-32954
> Project: Spark
> Issue Type: Improvement
> Components: YARN
> Affects Versions: 3.1.0
> Reporter: Yang Jie
> Priority: Minor
>
> When I tried to verify that the resource-managers yarn module passed all UTs in Scala 2.13 , I found that there are some problems blocking the test:
> # resource-managers/yarn module is not explicit dependency on sql/hive module but some case need HiveConf like `run Python application in yarn-client mode` in YarnClusterSuite, so we can't test resource-managers/yarn module independently as follow:
> ## mvn clean install -DskipTests -pl resource-managers/yarn -Pyarn -Pscala-2.13 -am
> ## mvn clean test -pl resource-managers/yarn -Pyarn -Pscala-2.13
> # There are more than one `servlet-api` dependency in spark now, one is `javax.servlet:javax.servlet-api:3.10:compile` we config in core/pom.xml, the other is `jakarta.servlet:jakarta.servlet-api:4.0.3:test` cascaded by `org.glassfish.jersey.test-framework.providers`, we can use `mvn dependency:tree` to check it .So when we execute resource-managers yarn module test independently, if the position of `javax.servlet:javax.servlet-api:3.10:compile` in the in classpath is before `jakarta.servlet:jakarta.servlet-api:4.0.3:test`, there are some cases failed in YarnClusterSuite, YarnShuffleIntegrationSuite and YarnShuffleAuthSuite
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org