You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Guoqiang Li (JIRA)" <ji...@apache.org> on 2014/05/01 13:22:15 UTC

[jira] [Comment Edited] (SPARK-1693) Most of the tests throw a java.lang.SecurityException when spark built for hadoop 2.3.0 , 2.4.0

    [ https://issues.apache.org/jira/browse/SPARK-1693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13986504#comment-13986504 ] 

Guoqiang Li edited comment on SPARK-1693 at 5/1/14 11:20 AM:
-------------------------------------------------------------

The dependency path is as follows
{code}hadoop-client=> hadoop-mapreduce-client-core => hadoop-yarn-common=>servlet-api{code}
Yarn work in the hadoop cluster,and hadoop already contains servlet-api in {code}${HADOOP_COMMON_HOME_HOME}/share/hadoop/yarn/lib/servlet-api-2.5.jar{code}
I guess "#1" should be no problem,but there is no test


was (Author: gq):
The dependency path is as follows
{code}hadoop-client=> hadoop-mapreduce-client-core => hadoop-yarn-common=>servlet-api{code}
Yarn work in the hadoop,and hadoop already contains servlet-api in {code}${HADOOP_COMMON_HOME_HOME}/share/hadoop/yarn/lib/servlet-api-2.5.jar{code}
I guess "#1" should be no problem,but there is no test

> Most of the tests throw a java.lang.SecurityException when spark built for hadoop 2.3.0 , 2.4.0 
> ------------------------------------------------------------------------------------------------
>
>                 Key: SPARK-1693
>                 URL: https://issues.apache.org/jira/browse/SPARK-1693
>             Project: Spark
>          Issue Type: Bug
>          Components: Spark Core
>            Reporter: Guoqiang Li
>            Assignee: Guoqiang Li
>         Attachments: log.txt
>
>
> {code}mvn test -Pyarn -Dhadoop.version=2.4.0 -Dyarn.version=2.4.0 > log.txt{code}
> The log: 
> {code}
> UnpersistSuite:
> - unpersist RDD *** FAILED ***
>   java.lang.SecurityException: class "javax.servlet.FilterRegistration"'s signer information does not match signer information of other classes in the same package
>   at java.lang.ClassLoader.checkCerts(ClassLoader.java:952)
>   at java.lang.ClassLoader.preDefineClass(ClassLoader.java:666)
>   at java.lang.ClassLoader.defineClass(ClassLoader.java:794)
>   at java.security.SecureClassLoader.defineClass(SecureClassLoader.java:142)
>   at java.net.URLClassLoader.defineClass(URLClassLoader.java:449)
>   at java.net.URLClassLoader.access$100(URLClassLoader.java:71)
>   at java.net.URLClassLoader$1.run(URLClassLoader.java:361)
>   at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
>   at java.security.AccessController.doPrivileged(Native Method)
>   at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
> {code}



--
This message was sent by Atlassian JIRA
(v6.2#6252)