You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@spark.apache.org by toivoa <to...@gmail.com> on 2014/06/09 15:34:50 UTC

Spark 1.0.0 Maven dependencies problems.

Using 
	<dependency>
		<groupId>org.apache.spark</groupId>
		<artifactId>spark-core_2.10</artifactId>
		<version>1.0.0</version>
	</dependency>
	  
I can create simple test and run under Eclipse.
But when I try to deploy on test server I have dependencies problems.

1. Spark requires 
    <artifactId>akka-remote_2.10</artifactId>
    <version>2.2.3-shaded-protobuf</version>

      And this in turn requires 

        <dependency>
            <groupId>io.netty</groupId>
            <artifactId>netty</artifactId>
            <version>3.6.6.Final</version>
        </dependency>

2. At the same time Spark itself requires 
    <artifactId>netty-parent</artifactId>
    <version>4.0.17.Final</version>

So now I have different Netty versions and I get either 

Exception in thread "main" java.lang.SecurityException: class
"javax.servlet.FilterRegistration"'s signer information does not match
signer information of other classes in the same package

When using 3.6.6.Final


Or

14/06/09 16:08:10 ERROR ActorSystemImpl: Uncaught fatal error from thread
[spark-akka.actor.default-dispatcher-4] shutting down ActorSystem [spark]
java.lang.NoClassDefFoundError: org/jboss/netty/util/Timer

When using 4.0.17.Final



What I am doing wrong and how to solve problem?

Thanks 
toivo




--
View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Spark-1-0-0-Maven-dependencies-problems-tp7247.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.

Re: Spark 1.0.0 Maven dependencies problems.

Posted by toivoa <to...@gmail.com>.
Thanks for the hint.

I removed signature info from same jar and JVM is happy now.

But problem remains, several same jar's but different versions, not good.

Spark itself is very, very promising, I am very excited


Thank you all
toivo



--
View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Spark-1-0-0-Maven-dependencies-problems-tp7247p7309.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.

Re: Spark 1.0.0 Maven dependencies problems.

Posted by Tobias Pfeiffer <tg...@preferred.jp>.
Hi,

(Apparently Google Mail is quite eager to send out mails when
Ctrl+Enter is hit by accident. Sorry for the previous email.)

I remembered I saw this as well and found this ugly comment in my
build.sbt file:
/*
 * [...], there is still a problem with some classes
 * in javax.servlet (from org.eclipse.jetty.orbit) being signed, while others
 * (from org.mortbay.jetty) are not. When using "sbt run", this is not a
 * problem, but IntelliJ IDEA refuses to run the main classes, raising a
 * SecurityException. In order to deal with that, remove the signature from
 * org.eclipse.jetty.orbit/javax.servlet/jars/javax.servlet-3.0.0.v201112011016.jar
 * file manually.
 */

Tobias

On Tue, Jun 10, 2014 at 10:47 AM, Tobias Pfeiffer <tg...@preferred.jp> wrote:
> Hi,
>
> I remembered I saw this as well and found this ugly comment in my
> build.sbt file:
>
>
> On Mon, Jun 9, 2014 at 11:37 PM, Sean Owen <so...@cloudera.com> wrote:
>> Looks like this crept in again from the shaded Akka dependency. I'll
>> propose a PR to remove it. I believe that remains the way we have to
>> deal with the differing Netty/Jetty dependencies floating around.
>>
>> On Mon, Jun 9, 2014 at 9:53 AM, toivoa <to...@gmail.com> wrote:
>>> I am using Maven from Eclipse
>>>
>>> dependency:tree shows
>>>
>>>
>>> [INFO] +- org.apache.spark:spark-core_2.10:jar:1.0.0:compile
>>> [INFO] |  +- net.java.dev.jets3t:jets3t:jar:0.7.1:runtime
>>> [INFO] |  +- org.apache.curator:curator-recipes:jar:2.4.0:compile
>>> [INFO] |  |  +- org.apache.curator:curator-framework:jar:2.4.0:compile
>>> [INFO] |  |  |  \- org.apache.curator:curator-client:jar:2.4.0:compile
>>> [INFO] |  |  \- org.apache.zookeeper:zookeeper:jar:3.4.5:compile
>>> [INFO] |  |     \- jline:jline:jar:0.9.94:compile
>>> [INFO] |  +- org.eclipse.jetty:jetty-plus:jar:8.1.14.v20131031:compile
>>> [INFO] |  |  +-
>>> org.eclipse.jetty.orbit:javax.transaction:jar:1.1.1.v201105210645:compile
>>> [INFO] |  |  +- org.eclipse.jetty:jetty-webapp:jar:8.1.14.v20131031:compile
>>> [INFO] |  |  |  +- org.eclipse.jetty:jetty-xml:jar:8.1.14.v20131031:compile
>>> [INFO] |  |  |  \-
>>> org.eclipse.jetty:jetty-servlet:jar:8.1.14.v20131031:compile
>>> [INFO] |  |  \- org.eclipse.jetty:jetty-jndi:jar:8.1.14.v20131031:compile
>>> [INFO] |  |     \-
>>> org.eclipse.jetty.orbit:javax.mail.glassfish:jar:1.4.1.v201005082020:compile
>>> [INFO] |  |        \-
>>> org.eclipse.jetty.orbit:javax.activation:jar:1.1.0.v201105071233:compile
>>> [INFO] |  +- org.eclipse.jetty:jetty-security:jar:8.1.14.v20131031:compile
>>> [INFO] |  +- org.eclipse.jetty:jetty-server:jar:8.1.14.v20131031:compile
>>> [INFO] |  |  +-
>>> org.eclipse.jetty.orbit:javax.servlet:jar:3.0.0.v201112011016:compile
>>> [INFO] |  |  +-
>>> org.eclipse.jetty:jetty-continuation:jar:8.1.14.v20131031:compile
>>> [INFO] |  |  \- org.eclipse.jetty:jetty-http:jar:8.1.14.v20131031:compile
>>> [INFO] |  |     \- org.eclipse.jetty:jetty-io:jar:8.1.14.v20131031:compile
>>> [INFO] |  +- com.google.guava:guava:jar:14.0.1:compile
>>> [INFO] |  +- org.apache.commons:commons-lang3:jar:3.3.2:compile
>>> [INFO] |  +- com.google.code.findbugs:jsr305:jar:1.3.9:compile
>>> [INFO] |  +- org.slf4j:slf4j-api:jar:1.7.5:compile
>>> [INFO] |  +- org.slf4j:jul-to-slf4j:jar:1.7.5:compile
>>> [INFO] |  +- org.slf4j:jcl-over-slf4j:jar:1.7.5:compile
>>> [INFO] |  +- log4j:log4j:jar:1.2.17:compile
>>> [INFO] |  +- org.slf4j:slf4j-log4j12:jar:1.7.5:compile
>>> [INFO] |  +- com.ning:compress-lzf:jar:1.0.0:compile
>>> [INFO] |  +- org.xerial.snappy:snappy-java:jar:1.0.5:compile
>>> [INFO] |  +- com.twitter:chill_2.10:jar:0.3.6:compile
>>> [INFO] |  |  \- com.esotericsoftware.kryo:kryo:jar:2.21:compile
>>> [INFO] |  |     +-
>>> com.esotericsoftware.reflectasm:reflectasm:jar:shaded:1.07:compile
>>> [INFO] |  |     +- com.esotericsoftware.minlog:minlog:jar:1.2:compile
>>> [INFO] |  |     \- org.objenesis:objenesis:jar:1.2:compile
>>> [INFO] |  +- com.twitter:chill-java:jar:0.3.6:compile
>>> [INFO] |  +- commons-net:commons-net:jar:2.2:compile
>>> [INFO] |  +-
>>> org.spark-project.akka:akka-remote_2.10:jar:2.2.3-shaded-protobuf:compile
>>> [INFO] |  |  +-
>>> org.spark-project.akka:akka-actor_2.10:jar:2.2.3-shaded-protobuf:compile
>>> [INFO] |  |  |  \- com.typesafe:config:jar:1.0.2:compile
>>> [INFO] |  |  +- io.netty:netty:jar:3.6.6.Final:compile
>>> [INFO] |  |  +-
>>> org.spark-project.protobuf:protobuf-java:jar:2.4.1-shaded:compile
>>> [INFO] |  |  \- org.uncommons.maths:uncommons-maths:jar:1.2.2a:compile
>>> [INFO] |  +-
>>> org.spark-project.akka:akka-slf4j_2.10:jar:2.2.3-shaded-protobuf:compile
>>> [INFO] |  +- org.scala-lang:scala-library:jar:2.10.4:compile
>>> [INFO] |  +- org.json4s:json4s-jackson_2.10:jar:3.2.6:compile
>>> [INFO] |  |  +- org.json4s:json4s-core_2.10:jar:3.2.6:compile
>>> [INFO] |  |  |  +- org.json4s:json4s-ast_2.10:jar:3.2.6:compile
>>> [INFO] |  |  |  +- com.thoughtworks.paranamer:paranamer:jar:2.6:compile
>>> [INFO] |  |  |  \- org.scala-lang:scalap:jar:2.10.0:compile
>>> [INFO] |  |  |     \- org.scala-lang:scala-compiler:jar:2.10.0:compile
>>> [INFO] |  |  |        \- org.scala-lang:scala-reflect:jar:2.10.0:compile
>>> [INFO] |  |  \-
>>> com.fasterxml.jackson.core:jackson-databind:jar:2.3.0:compile
>>> [INFO] |  |     +-
>>> com.fasterxml.jackson.core:jackson-annotations:jar:2.3.0:compile
>>> [INFO] |  |     \- com.fasterxml.jackson.core:jackson-core:jar:2.3.0:compile
>>> [INFO] |  +- colt:colt:jar:1.2.0:compile
>>> [INFO] |  |  \- concurrent:concurrent:jar:1.3.4:compile
>>> [INFO] |  +- org.apache.mesos:mesos:jar:shaded-protobuf:0.18.1:compile
>>> [INFO] |  +- io.netty:netty-all:jar:4.0.17.Final:compile
>>> [INFO] |  +- com.clearspring.analytics:stream:jar:2.5.1:compile
>>> [INFO] |  +- com.codahale.metrics:metrics-core:jar:3.0.0:compile
>>> [INFO] |  +- com.codahale.metrics:metrics-jvm:jar:3.0.0:compile
>>> [INFO] |  +- com.codahale.metrics:metrics-json:jar:3.0.0:compile
>>> [INFO] |  +- com.codahale.metrics:metrics-graphite:jar:3.0.0:compile
>>> [INFO] |  +- org.tachyonproject:tachyon:jar:0.4.1-thrift:compile
>>> [INFO] |  |  +- org.apache.ant:ant:jar:1.9.0:compile
>>> [INFO] |  |  |  \- org.apache.ant:ant-launcher:jar:1.9.0:compile
>>> [INFO] |  |  \- commons-io:commons-io:jar:2.4:compile
>>> [INFO] |  +- org.spark-project:pyrolite:jar:2.0.1:compile
>>> [INFO] |  \- net.sf.py4j:py4j:jar:0.8.1:compile
>>> [INFO] +- org.apache.hadoop:hadoop-client:jar:2.4.0:compile
>>> [INFO] |  +- org.apache.hadoop:hadoop-common:jar:2.4.0:compile
>>> [INFO] |  |  +- org.apache.commons:commons-math3:jar:3.1.1:compile
>>> [INFO] |  |  +- xmlenc:xmlenc:jar:0.52:compile
>>> [INFO] |  |  +- commons-httpclient:commons-httpclient:jar:3.1:compile
>>> [INFO] |  |  +- commons-codec:commons-codec:jar:1.4:compile
>>> [INFO] |  |  +- commons-collections:commons-collections:jar:3.2.1:compile
>>> [INFO] |  |  +- commons-logging:commons-logging:jar:1.1.3:compile
>>> [INFO] |  |  +- commons-lang:commons-lang:jar:2.6:compile
>>> [INFO] |  |  +- commons-configuration:commons-configuration:jar:1.6:compile
>>> [INFO] |  |  |  +- commons-digester:commons-digester:jar:1.8:compile
>>> [INFO] |  |  |  |  \- commons-beanutils:commons-beanutils:jar:1.7.0:compile
>>> [INFO] |  |  |  \-
>>> commons-beanutils:commons-beanutils-core:jar:1.8.0:compile
>>> [INFO] |  |  +- org.codehaus.jackson:jackson-core-asl:jar:1.8.8:compile
>>> [INFO] |  |  +- org.codehaus.jackson:jackson-mapper-asl:jar:1.8.8:compile
>>> [INFO] |  |  +- org.apache.avro:avro:jar:1.7.4:compile
>>> [INFO] |  |  +- com.google.protobuf:protobuf-java:jar:2.5.0:compile
>>> [INFO] |  |  +- org.apache.hadoop:hadoop-auth:jar:2.4.0:compile
>>> [INFO] |  |  |  \- org.apache.httpcomponents:httpclient:jar:4.2.5:compile
>>> [INFO] |  |  |     \- org.apache.httpcomponents:httpcore:jar:4.2.4:compile
>>> [INFO] |  |  \- org.apache.commons:commons-compress:jar:1.4.1:compile
>>> [INFO] |  |     \- org.tukaani:xz:jar:1.0:compile
>>> [INFO] |  +- org.apache.hadoop:hadoop-hdfs:jar:2.4.0:compile
>>> [INFO] |  |  \- org.mortbay.jetty:jetty-util:jar:6.1.26:compile
>>> [INFO] |  +- org.apache.hadoop:hadoop-mapreduce-client-app:jar:2.4.0:compile
>>> [INFO] |  |  +-
>>> org.apache.hadoop:hadoop-mapreduce-client-common:jar:2.4.0:compile
>>> [INFO] |  |  |  +- org.apache.hadoop:hadoop-yarn-client:jar:2.4.0:compile
>>> [INFO] |  |  |  |  \- com.sun.jersey:jersey-client:jar:1.9:compile
>>> [INFO] |  |  |  \-
>>> org.apache.hadoop:hadoop-yarn-server-common:jar:2.4.0:compile
>>> [INFO] |  |  \-
>>> org.apache.hadoop:hadoop-mapreduce-client-shuffle:jar:2.4.0:compile
>>> [INFO] |  +- org.apache.hadoop:hadoop-yarn-api:jar:2.4.0:compile
>>> [INFO] |  +-
>>> org.apache.hadoop:hadoop-mapreduce-client-core:jar:2.4.0:compile
>>> [INFO] |  |  \- org.apache.hadoop:hadoop-yarn-common:jar:2.4.0:compile
>>> [INFO] |  |     +- javax.xml.bind:jaxb-api:jar:2.2.2:compile
>>> [INFO] |  |     |  +- javax.xml.stream:stax-api:jar:1.0-2:compile
>>> [INFO] |  |     |  \- javax.activation:activation:jar:1.1:compile
>>> [INFO] |  |     +- javax.servlet:servlet-api:jar:2.5:compile
>>> [INFO] |  |     \- com.sun.jersey:jersey-core:jar:1.9:compile
>>> [INFO] |  +-
>>> org.apache.hadoop:hadoop-mapreduce-client-jobclient:jar:2.4.0:compile
>>> [INFO] |  \- org.apache.hadoop:hadoop-annotations:jar:2.4.0:compile
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>> --
>>> View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Spark-1-0-0-Maven-dependencies-problems-tp7247p7249.html
>>> Sent from the Apache Spark User List mailing list archive at Nabble.com.

Re: Spark 1.0.0 Maven dependencies problems.

Posted by Tobias Pfeiffer <tg...@preferred.jp>.
Hi,

I remembered I saw this as well and found this ugly comment in my
build.sbt file:


On Mon, Jun 9, 2014 at 11:37 PM, Sean Owen <so...@cloudera.com> wrote:
> Looks like this crept in again from the shaded Akka dependency. I'll
> propose a PR to remove it. I believe that remains the way we have to
> deal with the differing Netty/Jetty dependencies floating around.
>
> On Mon, Jun 9, 2014 at 9:53 AM, toivoa <to...@gmail.com> wrote:
>> I am using Maven from Eclipse
>>
>> dependency:tree shows
>>
>>
>> [INFO] +- org.apache.spark:spark-core_2.10:jar:1.0.0:compile
>> [INFO] |  +- net.java.dev.jets3t:jets3t:jar:0.7.1:runtime
>> [INFO] |  +- org.apache.curator:curator-recipes:jar:2.4.0:compile
>> [INFO] |  |  +- org.apache.curator:curator-framework:jar:2.4.0:compile
>> [INFO] |  |  |  \- org.apache.curator:curator-client:jar:2.4.0:compile
>> [INFO] |  |  \- org.apache.zookeeper:zookeeper:jar:3.4.5:compile
>> [INFO] |  |     \- jline:jline:jar:0.9.94:compile
>> [INFO] |  +- org.eclipse.jetty:jetty-plus:jar:8.1.14.v20131031:compile
>> [INFO] |  |  +-
>> org.eclipse.jetty.orbit:javax.transaction:jar:1.1.1.v201105210645:compile
>> [INFO] |  |  +- org.eclipse.jetty:jetty-webapp:jar:8.1.14.v20131031:compile
>> [INFO] |  |  |  +- org.eclipse.jetty:jetty-xml:jar:8.1.14.v20131031:compile
>> [INFO] |  |  |  \-
>> org.eclipse.jetty:jetty-servlet:jar:8.1.14.v20131031:compile
>> [INFO] |  |  \- org.eclipse.jetty:jetty-jndi:jar:8.1.14.v20131031:compile
>> [INFO] |  |     \-
>> org.eclipse.jetty.orbit:javax.mail.glassfish:jar:1.4.1.v201005082020:compile
>> [INFO] |  |        \-
>> org.eclipse.jetty.orbit:javax.activation:jar:1.1.0.v201105071233:compile
>> [INFO] |  +- org.eclipse.jetty:jetty-security:jar:8.1.14.v20131031:compile
>> [INFO] |  +- org.eclipse.jetty:jetty-server:jar:8.1.14.v20131031:compile
>> [INFO] |  |  +-
>> org.eclipse.jetty.orbit:javax.servlet:jar:3.0.0.v201112011016:compile
>> [INFO] |  |  +-
>> org.eclipse.jetty:jetty-continuation:jar:8.1.14.v20131031:compile
>> [INFO] |  |  \- org.eclipse.jetty:jetty-http:jar:8.1.14.v20131031:compile
>> [INFO] |  |     \- org.eclipse.jetty:jetty-io:jar:8.1.14.v20131031:compile
>> [INFO] |  +- com.google.guava:guava:jar:14.0.1:compile
>> [INFO] |  +- org.apache.commons:commons-lang3:jar:3.3.2:compile
>> [INFO] |  +- com.google.code.findbugs:jsr305:jar:1.3.9:compile
>> [INFO] |  +- org.slf4j:slf4j-api:jar:1.7.5:compile
>> [INFO] |  +- org.slf4j:jul-to-slf4j:jar:1.7.5:compile
>> [INFO] |  +- org.slf4j:jcl-over-slf4j:jar:1.7.5:compile
>> [INFO] |  +- log4j:log4j:jar:1.2.17:compile
>> [INFO] |  +- org.slf4j:slf4j-log4j12:jar:1.7.5:compile
>> [INFO] |  +- com.ning:compress-lzf:jar:1.0.0:compile
>> [INFO] |  +- org.xerial.snappy:snappy-java:jar:1.0.5:compile
>> [INFO] |  +- com.twitter:chill_2.10:jar:0.3.6:compile
>> [INFO] |  |  \- com.esotericsoftware.kryo:kryo:jar:2.21:compile
>> [INFO] |  |     +-
>> com.esotericsoftware.reflectasm:reflectasm:jar:shaded:1.07:compile
>> [INFO] |  |     +- com.esotericsoftware.minlog:minlog:jar:1.2:compile
>> [INFO] |  |     \- org.objenesis:objenesis:jar:1.2:compile
>> [INFO] |  +- com.twitter:chill-java:jar:0.3.6:compile
>> [INFO] |  +- commons-net:commons-net:jar:2.2:compile
>> [INFO] |  +-
>> org.spark-project.akka:akka-remote_2.10:jar:2.2.3-shaded-protobuf:compile
>> [INFO] |  |  +-
>> org.spark-project.akka:akka-actor_2.10:jar:2.2.3-shaded-protobuf:compile
>> [INFO] |  |  |  \- com.typesafe:config:jar:1.0.2:compile
>> [INFO] |  |  +- io.netty:netty:jar:3.6.6.Final:compile
>> [INFO] |  |  +-
>> org.spark-project.protobuf:protobuf-java:jar:2.4.1-shaded:compile
>> [INFO] |  |  \- org.uncommons.maths:uncommons-maths:jar:1.2.2a:compile
>> [INFO] |  +-
>> org.spark-project.akka:akka-slf4j_2.10:jar:2.2.3-shaded-protobuf:compile
>> [INFO] |  +- org.scala-lang:scala-library:jar:2.10.4:compile
>> [INFO] |  +- org.json4s:json4s-jackson_2.10:jar:3.2.6:compile
>> [INFO] |  |  +- org.json4s:json4s-core_2.10:jar:3.2.6:compile
>> [INFO] |  |  |  +- org.json4s:json4s-ast_2.10:jar:3.2.6:compile
>> [INFO] |  |  |  +- com.thoughtworks.paranamer:paranamer:jar:2.6:compile
>> [INFO] |  |  |  \- org.scala-lang:scalap:jar:2.10.0:compile
>> [INFO] |  |  |     \- org.scala-lang:scala-compiler:jar:2.10.0:compile
>> [INFO] |  |  |        \- org.scala-lang:scala-reflect:jar:2.10.0:compile
>> [INFO] |  |  \-
>> com.fasterxml.jackson.core:jackson-databind:jar:2.3.0:compile
>> [INFO] |  |     +-
>> com.fasterxml.jackson.core:jackson-annotations:jar:2.3.0:compile
>> [INFO] |  |     \- com.fasterxml.jackson.core:jackson-core:jar:2.3.0:compile
>> [INFO] |  +- colt:colt:jar:1.2.0:compile
>> [INFO] |  |  \- concurrent:concurrent:jar:1.3.4:compile
>> [INFO] |  +- org.apache.mesos:mesos:jar:shaded-protobuf:0.18.1:compile
>> [INFO] |  +- io.netty:netty-all:jar:4.0.17.Final:compile
>> [INFO] |  +- com.clearspring.analytics:stream:jar:2.5.1:compile
>> [INFO] |  +- com.codahale.metrics:metrics-core:jar:3.0.0:compile
>> [INFO] |  +- com.codahale.metrics:metrics-jvm:jar:3.0.0:compile
>> [INFO] |  +- com.codahale.metrics:metrics-json:jar:3.0.0:compile
>> [INFO] |  +- com.codahale.metrics:metrics-graphite:jar:3.0.0:compile
>> [INFO] |  +- org.tachyonproject:tachyon:jar:0.4.1-thrift:compile
>> [INFO] |  |  +- org.apache.ant:ant:jar:1.9.0:compile
>> [INFO] |  |  |  \- org.apache.ant:ant-launcher:jar:1.9.0:compile
>> [INFO] |  |  \- commons-io:commons-io:jar:2.4:compile
>> [INFO] |  +- org.spark-project:pyrolite:jar:2.0.1:compile
>> [INFO] |  \- net.sf.py4j:py4j:jar:0.8.1:compile
>> [INFO] +- org.apache.hadoop:hadoop-client:jar:2.4.0:compile
>> [INFO] |  +- org.apache.hadoop:hadoop-common:jar:2.4.0:compile
>> [INFO] |  |  +- org.apache.commons:commons-math3:jar:3.1.1:compile
>> [INFO] |  |  +- xmlenc:xmlenc:jar:0.52:compile
>> [INFO] |  |  +- commons-httpclient:commons-httpclient:jar:3.1:compile
>> [INFO] |  |  +- commons-codec:commons-codec:jar:1.4:compile
>> [INFO] |  |  +- commons-collections:commons-collections:jar:3.2.1:compile
>> [INFO] |  |  +- commons-logging:commons-logging:jar:1.1.3:compile
>> [INFO] |  |  +- commons-lang:commons-lang:jar:2.6:compile
>> [INFO] |  |  +- commons-configuration:commons-configuration:jar:1.6:compile
>> [INFO] |  |  |  +- commons-digester:commons-digester:jar:1.8:compile
>> [INFO] |  |  |  |  \- commons-beanutils:commons-beanutils:jar:1.7.0:compile
>> [INFO] |  |  |  \-
>> commons-beanutils:commons-beanutils-core:jar:1.8.0:compile
>> [INFO] |  |  +- org.codehaus.jackson:jackson-core-asl:jar:1.8.8:compile
>> [INFO] |  |  +- org.codehaus.jackson:jackson-mapper-asl:jar:1.8.8:compile
>> [INFO] |  |  +- org.apache.avro:avro:jar:1.7.4:compile
>> [INFO] |  |  +- com.google.protobuf:protobuf-java:jar:2.5.0:compile
>> [INFO] |  |  +- org.apache.hadoop:hadoop-auth:jar:2.4.0:compile
>> [INFO] |  |  |  \- org.apache.httpcomponents:httpclient:jar:4.2.5:compile
>> [INFO] |  |  |     \- org.apache.httpcomponents:httpcore:jar:4.2.4:compile
>> [INFO] |  |  \- org.apache.commons:commons-compress:jar:1.4.1:compile
>> [INFO] |  |     \- org.tukaani:xz:jar:1.0:compile
>> [INFO] |  +- org.apache.hadoop:hadoop-hdfs:jar:2.4.0:compile
>> [INFO] |  |  \- org.mortbay.jetty:jetty-util:jar:6.1.26:compile
>> [INFO] |  +- org.apache.hadoop:hadoop-mapreduce-client-app:jar:2.4.0:compile
>> [INFO] |  |  +-
>> org.apache.hadoop:hadoop-mapreduce-client-common:jar:2.4.0:compile
>> [INFO] |  |  |  +- org.apache.hadoop:hadoop-yarn-client:jar:2.4.0:compile
>> [INFO] |  |  |  |  \- com.sun.jersey:jersey-client:jar:1.9:compile
>> [INFO] |  |  |  \-
>> org.apache.hadoop:hadoop-yarn-server-common:jar:2.4.0:compile
>> [INFO] |  |  \-
>> org.apache.hadoop:hadoop-mapreduce-client-shuffle:jar:2.4.0:compile
>> [INFO] |  +- org.apache.hadoop:hadoop-yarn-api:jar:2.4.0:compile
>> [INFO] |  +-
>> org.apache.hadoop:hadoop-mapreduce-client-core:jar:2.4.0:compile
>> [INFO] |  |  \- org.apache.hadoop:hadoop-yarn-common:jar:2.4.0:compile
>> [INFO] |  |     +- javax.xml.bind:jaxb-api:jar:2.2.2:compile
>> [INFO] |  |     |  +- javax.xml.stream:stax-api:jar:1.0-2:compile
>> [INFO] |  |     |  \- javax.activation:activation:jar:1.1:compile
>> [INFO] |  |     +- javax.servlet:servlet-api:jar:2.5:compile
>> [INFO] |  |     \- com.sun.jersey:jersey-core:jar:1.9:compile
>> [INFO] |  +-
>> org.apache.hadoop:hadoop-mapreduce-client-jobclient:jar:2.4.0:compile
>> [INFO] |  \- org.apache.hadoop:hadoop-annotations:jar:2.4.0:compile
>>
>>
>>
>>
>>
>>
>>
>>
>> --
>> View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Spark-1-0-0-Maven-dependencies-problems-tp7247p7249.html
>> Sent from the Apache Spark User List mailing list archive at Nabble.com.

Re: Spark 1.0.0 Maven dependencies problems.

Posted by Sean Owen <so...@cloudera.com>.
Looks like this crept in again from the shaded Akka dependency. I'll
propose a PR to remove it. I believe that remains the way we have to
deal with the differing Netty/Jetty dependencies floating around.

On Mon, Jun 9, 2014 at 9:53 AM, toivoa <to...@gmail.com> wrote:
> I am using Maven from Eclipse
>
> dependency:tree shows
>
>
> [INFO] +- org.apache.spark:spark-core_2.10:jar:1.0.0:compile
> [INFO] |  +- net.java.dev.jets3t:jets3t:jar:0.7.1:runtime
> [INFO] |  +- org.apache.curator:curator-recipes:jar:2.4.0:compile
> [INFO] |  |  +- org.apache.curator:curator-framework:jar:2.4.0:compile
> [INFO] |  |  |  \- org.apache.curator:curator-client:jar:2.4.0:compile
> [INFO] |  |  \- org.apache.zookeeper:zookeeper:jar:3.4.5:compile
> [INFO] |  |     \- jline:jline:jar:0.9.94:compile
> [INFO] |  +- org.eclipse.jetty:jetty-plus:jar:8.1.14.v20131031:compile
> [INFO] |  |  +-
> org.eclipse.jetty.orbit:javax.transaction:jar:1.1.1.v201105210645:compile
> [INFO] |  |  +- org.eclipse.jetty:jetty-webapp:jar:8.1.14.v20131031:compile
> [INFO] |  |  |  +- org.eclipse.jetty:jetty-xml:jar:8.1.14.v20131031:compile
> [INFO] |  |  |  \-
> org.eclipse.jetty:jetty-servlet:jar:8.1.14.v20131031:compile
> [INFO] |  |  \- org.eclipse.jetty:jetty-jndi:jar:8.1.14.v20131031:compile
> [INFO] |  |     \-
> org.eclipse.jetty.orbit:javax.mail.glassfish:jar:1.4.1.v201005082020:compile
> [INFO] |  |        \-
> org.eclipse.jetty.orbit:javax.activation:jar:1.1.0.v201105071233:compile
> [INFO] |  +- org.eclipse.jetty:jetty-security:jar:8.1.14.v20131031:compile
> [INFO] |  +- org.eclipse.jetty:jetty-server:jar:8.1.14.v20131031:compile
> [INFO] |  |  +-
> org.eclipse.jetty.orbit:javax.servlet:jar:3.0.0.v201112011016:compile
> [INFO] |  |  +-
> org.eclipse.jetty:jetty-continuation:jar:8.1.14.v20131031:compile
> [INFO] |  |  \- org.eclipse.jetty:jetty-http:jar:8.1.14.v20131031:compile
> [INFO] |  |     \- org.eclipse.jetty:jetty-io:jar:8.1.14.v20131031:compile
> [INFO] |  +- com.google.guava:guava:jar:14.0.1:compile
> [INFO] |  +- org.apache.commons:commons-lang3:jar:3.3.2:compile
> [INFO] |  +- com.google.code.findbugs:jsr305:jar:1.3.9:compile
> [INFO] |  +- org.slf4j:slf4j-api:jar:1.7.5:compile
> [INFO] |  +- org.slf4j:jul-to-slf4j:jar:1.7.5:compile
> [INFO] |  +- org.slf4j:jcl-over-slf4j:jar:1.7.5:compile
> [INFO] |  +- log4j:log4j:jar:1.2.17:compile
> [INFO] |  +- org.slf4j:slf4j-log4j12:jar:1.7.5:compile
> [INFO] |  +- com.ning:compress-lzf:jar:1.0.0:compile
> [INFO] |  +- org.xerial.snappy:snappy-java:jar:1.0.5:compile
> [INFO] |  +- com.twitter:chill_2.10:jar:0.3.6:compile
> [INFO] |  |  \- com.esotericsoftware.kryo:kryo:jar:2.21:compile
> [INFO] |  |     +-
> com.esotericsoftware.reflectasm:reflectasm:jar:shaded:1.07:compile
> [INFO] |  |     +- com.esotericsoftware.minlog:minlog:jar:1.2:compile
> [INFO] |  |     \- org.objenesis:objenesis:jar:1.2:compile
> [INFO] |  +- com.twitter:chill-java:jar:0.3.6:compile
> [INFO] |  +- commons-net:commons-net:jar:2.2:compile
> [INFO] |  +-
> org.spark-project.akka:akka-remote_2.10:jar:2.2.3-shaded-protobuf:compile
> [INFO] |  |  +-
> org.spark-project.akka:akka-actor_2.10:jar:2.2.3-shaded-protobuf:compile
> [INFO] |  |  |  \- com.typesafe:config:jar:1.0.2:compile
> [INFO] |  |  +- io.netty:netty:jar:3.6.6.Final:compile
> [INFO] |  |  +-
> org.spark-project.protobuf:protobuf-java:jar:2.4.1-shaded:compile
> [INFO] |  |  \- org.uncommons.maths:uncommons-maths:jar:1.2.2a:compile
> [INFO] |  +-
> org.spark-project.akka:akka-slf4j_2.10:jar:2.2.3-shaded-protobuf:compile
> [INFO] |  +- org.scala-lang:scala-library:jar:2.10.4:compile
> [INFO] |  +- org.json4s:json4s-jackson_2.10:jar:3.2.6:compile
> [INFO] |  |  +- org.json4s:json4s-core_2.10:jar:3.2.6:compile
> [INFO] |  |  |  +- org.json4s:json4s-ast_2.10:jar:3.2.6:compile
> [INFO] |  |  |  +- com.thoughtworks.paranamer:paranamer:jar:2.6:compile
> [INFO] |  |  |  \- org.scala-lang:scalap:jar:2.10.0:compile
> [INFO] |  |  |     \- org.scala-lang:scala-compiler:jar:2.10.0:compile
> [INFO] |  |  |        \- org.scala-lang:scala-reflect:jar:2.10.0:compile
> [INFO] |  |  \-
> com.fasterxml.jackson.core:jackson-databind:jar:2.3.0:compile
> [INFO] |  |     +-
> com.fasterxml.jackson.core:jackson-annotations:jar:2.3.0:compile
> [INFO] |  |     \- com.fasterxml.jackson.core:jackson-core:jar:2.3.0:compile
> [INFO] |  +- colt:colt:jar:1.2.0:compile
> [INFO] |  |  \- concurrent:concurrent:jar:1.3.4:compile
> [INFO] |  +- org.apache.mesos:mesos:jar:shaded-protobuf:0.18.1:compile
> [INFO] |  +- io.netty:netty-all:jar:4.0.17.Final:compile
> [INFO] |  +- com.clearspring.analytics:stream:jar:2.5.1:compile
> [INFO] |  +- com.codahale.metrics:metrics-core:jar:3.0.0:compile
> [INFO] |  +- com.codahale.metrics:metrics-jvm:jar:3.0.0:compile
> [INFO] |  +- com.codahale.metrics:metrics-json:jar:3.0.0:compile
> [INFO] |  +- com.codahale.metrics:metrics-graphite:jar:3.0.0:compile
> [INFO] |  +- org.tachyonproject:tachyon:jar:0.4.1-thrift:compile
> [INFO] |  |  +- org.apache.ant:ant:jar:1.9.0:compile
> [INFO] |  |  |  \- org.apache.ant:ant-launcher:jar:1.9.0:compile
> [INFO] |  |  \- commons-io:commons-io:jar:2.4:compile
> [INFO] |  +- org.spark-project:pyrolite:jar:2.0.1:compile
> [INFO] |  \- net.sf.py4j:py4j:jar:0.8.1:compile
> [INFO] +- org.apache.hadoop:hadoop-client:jar:2.4.0:compile
> [INFO] |  +- org.apache.hadoop:hadoop-common:jar:2.4.0:compile
> [INFO] |  |  +- org.apache.commons:commons-math3:jar:3.1.1:compile
> [INFO] |  |  +- xmlenc:xmlenc:jar:0.52:compile
> [INFO] |  |  +- commons-httpclient:commons-httpclient:jar:3.1:compile
> [INFO] |  |  +- commons-codec:commons-codec:jar:1.4:compile
> [INFO] |  |  +- commons-collections:commons-collections:jar:3.2.1:compile
> [INFO] |  |  +- commons-logging:commons-logging:jar:1.1.3:compile
> [INFO] |  |  +- commons-lang:commons-lang:jar:2.6:compile
> [INFO] |  |  +- commons-configuration:commons-configuration:jar:1.6:compile
> [INFO] |  |  |  +- commons-digester:commons-digester:jar:1.8:compile
> [INFO] |  |  |  |  \- commons-beanutils:commons-beanutils:jar:1.7.0:compile
> [INFO] |  |  |  \-
> commons-beanutils:commons-beanutils-core:jar:1.8.0:compile
> [INFO] |  |  +- org.codehaus.jackson:jackson-core-asl:jar:1.8.8:compile
> [INFO] |  |  +- org.codehaus.jackson:jackson-mapper-asl:jar:1.8.8:compile
> [INFO] |  |  +- org.apache.avro:avro:jar:1.7.4:compile
> [INFO] |  |  +- com.google.protobuf:protobuf-java:jar:2.5.0:compile
> [INFO] |  |  +- org.apache.hadoop:hadoop-auth:jar:2.4.0:compile
> [INFO] |  |  |  \- org.apache.httpcomponents:httpclient:jar:4.2.5:compile
> [INFO] |  |  |     \- org.apache.httpcomponents:httpcore:jar:4.2.4:compile
> [INFO] |  |  \- org.apache.commons:commons-compress:jar:1.4.1:compile
> [INFO] |  |     \- org.tukaani:xz:jar:1.0:compile
> [INFO] |  +- org.apache.hadoop:hadoop-hdfs:jar:2.4.0:compile
> [INFO] |  |  \- org.mortbay.jetty:jetty-util:jar:6.1.26:compile
> [INFO] |  +- org.apache.hadoop:hadoop-mapreduce-client-app:jar:2.4.0:compile
> [INFO] |  |  +-
> org.apache.hadoop:hadoop-mapreduce-client-common:jar:2.4.0:compile
> [INFO] |  |  |  +- org.apache.hadoop:hadoop-yarn-client:jar:2.4.0:compile
> [INFO] |  |  |  |  \- com.sun.jersey:jersey-client:jar:1.9:compile
> [INFO] |  |  |  \-
> org.apache.hadoop:hadoop-yarn-server-common:jar:2.4.0:compile
> [INFO] |  |  \-
> org.apache.hadoop:hadoop-mapreduce-client-shuffle:jar:2.4.0:compile
> [INFO] |  +- org.apache.hadoop:hadoop-yarn-api:jar:2.4.0:compile
> [INFO] |  +-
> org.apache.hadoop:hadoop-mapreduce-client-core:jar:2.4.0:compile
> [INFO] |  |  \- org.apache.hadoop:hadoop-yarn-common:jar:2.4.0:compile
> [INFO] |  |     +- javax.xml.bind:jaxb-api:jar:2.2.2:compile
> [INFO] |  |     |  +- javax.xml.stream:stax-api:jar:1.0-2:compile
> [INFO] |  |     |  \- javax.activation:activation:jar:1.1:compile
> [INFO] |  |     +- javax.servlet:servlet-api:jar:2.5:compile
> [INFO] |  |     \- com.sun.jersey:jersey-core:jar:1.9:compile
> [INFO] |  +-
> org.apache.hadoop:hadoop-mapreduce-client-jobclient:jar:2.4.0:compile
> [INFO] |  \- org.apache.hadoop:hadoop-annotations:jar:2.4.0:compile
>
>
>
>
>
>
>
>
> --
> View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Spark-1-0-0-Maven-dependencies-problems-tp7247p7249.html
> Sent from the Apache Spark User List mailing list archive at Nabble.com.

Re: Spark 1.0.0 Maven dependencies problems.

Posted by toivoa <to...@gmail.com>.
I am using Maven from Eclipse

dependency:tree shows


[INFO] +- org.apache.spark:spark-core_2.10:jar:1.0.0:compile
[INFO] |  +- net.java.dev.jets3t:jets3t:jar:0.7.1:runtime
[INFO] |  +- org.apache.curator:curator-recipes:jar:2.4.0:compile
[INFO] |  |  +- org.apache.curator:curator-framework:jar:2.4.0:compile
[INFO] |  |  |  \- org.apache.curator:curator-client:jar:2.4.0:compile
[INFO] |  |  \- org.apache.zookeeper:zookeeper:jar:3.4.5:compile
[INFO] |  |     \- jline:jline:jar:0.9.94:compile
[INFO] |  +- org.eclipse.jetty:jetty-plus:jar:8.1.14.v20131031:compile
[INFO] |  |  +-
org.eclipse.jetty.orbit:javax.transaction:jar:1.1.1.v201105210645:compile
[INFO] |  |  +- org.eclipse.jetty:jetty-webapp:jar:8.1.14.v20131031:compile
[INFO] |  |  |  +- org.eclipse.jetty:jetty-xml:jar:8.1.14.v20131031:compile
[INFO] |  |  |  \-
org.eclipse.jetty:jetty-servlet:jar:8.1.14.v20131031:compile
[INFO] |  |  \- org.eclipse.jetty:jetty-jndi:jar:8.1.14.v20131031:compile
[INFO] |  |     \-
org.eclipse.jetty.orbit:javax.mail.glassfish:jar:1.4.1.v201005082020:compile
[INFO] |  |        \-
org.eclipse.jetty.orbit:javax.activation:jar:1.1.0.v201105071233:compile
[INFO] |  +- org.eclipse.jetty:jetty-security:jar:8.1.14.v20131031:compile
[INFO] |  +- org.eclipse.jetty:jetty-server:jar:8.1.14.v20131031:compile
[INFO] |  |  +-
org.eclipse.jetty.orbit:javax.servlet:jar:3.0.0.v201112011016:compile
[INFO] |  |  +-
org.eclipse.jetty:jetty-continuation:jar:8.1.14.v20131031:compile
[INFO] |  |  \- org.eclipse.jetty:jetty-http:jar:8.1.14.v20131031:compile
[INFO] |  |     \- org.eclipse.jetty:jetty-io:jar:8.1.14.v20131031:compile
[INFO] |  +- com.google.guava:guava:jar:14.0.1:compile
[INFO] |  +- org.apache.commons:commons-lang3:jar:3.3.2:compile
[INFO] |  +- com.google.code.findbugs:jsr305:jar:1.3.9:compile
[INFO] |  +- org.slf4j:slf4j-api:jar:1.7.5:compile
[INFO] |  +- org.slf4j:jul-to-slf4j:jar:1.7.5:compile
[INFO] |  +- org.slf4j:jcl-over-slf4j:jar:1.7.5:compile
[INFO] |  +- log4j:log4j:jar:1.2.17:compile
[INFO] |  +- org.slf4j:slf4j-log4j12:jar:1.7.5:compile
[INFO] |  +- com.ning:compress-lzf:jar:1.0.0:compile
[INFO] |  +- org.xerial.snappy:snappy-java:jar:1.0.5:compile
[INFO] |  +- com.twitter:chill_2.10:jar:0.3.6:compile
[INFO] |  |  \- com.esotericsoftware.kryo:kryo:jar:2.21:compile
[INFO] |  |     +-
com.esotericsoftware.reflectasm:reflectasm:jar:shaded:1.07:compile
[INFO] |  |     +- com.esotericsoftware.minlog:minlog:jar:1.2:compile
[INFO] |  |     \- org.objenesis:objenesis:jar:1.2:compile
[INFO] |  +- com.twitter:chill-java:jar:0.3.6:compile
[INFO] |  +- commons-net:commons-net:jar:2.2:compile
[INFO] |  +-
org.spark-project.akka:akka-remote_2.10:jar:2.2.3-shaded-protobuf:compile
[INFO] |  |  +-
org.spark-project.akka:akka-actor_2.10:jar:2.2.3-shaded-protobuf:compile
[INFO] |  |  |  \- com.typesafe:config:jar:1.0.2:compile
[INFO] |  |  +- io.netty:netty:jar:3.6.6.Final:compile
[INFO] |  |  +-
org.spark-project.protobuf:protobuf-java:jar:2.4.1-shaded:compile
[INFO] |  |  \- org.uncommons.maths:uncommons-maths:jar:1.2.2a:compile
[INFO] |  +-
org.spark-project.akka:akka-slf4j_2.10:jar:2.2.3-shaded-protobuf:compile
[INFO] |  +- org.scala-lang:scala-library:jar:2.10.4:compile
[INFO] |  +- org.json4s:json4s-jackson_2.10:jar:3.2.6:compile
[INFO] |  |  +- org.json4s:json4s-core_2.10:jar:3.2.6:compile
[INFO] |  |  |  +- org.json4s:json4s-ast_2.10:jar:3.2.6:compile
[INFO] |  |  |  +- com.thoughtworks.paranamer:paranamer:jar:2.6:compile
[INFO] |  |  |  \- org.scala-lang:scalap:jar:2.10.0:compile
[INFO] |  |  |     \- org.scala-lang:scala-compiler:jar:2.10.0:compile
[INFO] |  |  |        \- org.scala-lang:scala-reflect:jar:2.10.0:compile
[INFO] |  |  \-
com.fasterxml.jackson.core:jackson-databind:jar:2.3.0:compile
[INFO] |  |     +-
com.fasterxml.jackson.core:jackson-annotations:jar:2.3.0:compile
[INFO] |  |     \- com.fasterxml.jackson.core:jackson-core:jar:2.3.0:compile
[INFO] |  +- colt:colt:jar:1.2.0:compile
[INFO] |  |  \- concurrent:concurrent:jar:1.3.4:compile
[INFO] |  +- org.apache.mesos:mesos:jar:shaded-protobuf:0.18.1:compile
[INFO] |  +- io.netty:netty-all:jar:4.0.17.Final:compile
[INFO] |  +- com.clearspring.analytics:stream:jar:2.5.1:compile
[INFO] |  +- com.codahale.metrics:metrics-core:jar:3.0.0:compile
[INFO] |  +- com.codahale.metrics:metrics-jvm:jar:3.0.0:compile
[INFO] |  +- com.codahale.metrics:metrics-json:jar:3.0.0:compile
[INFO] |  +- com.codahale.metrics:metrics-graphite:jar:3.0.0:compile
[INFO] |  +- org.tachyonproject:tachyon:jar:0.4.1-thrift:compile
[INFO] |  |  +- org.apache.ant:ant:jar:1.9.0:compile
[INFO] |  |  |  \- org.apache.ant:ant-launcher:jar:1.9.0:compile
[INFO] |  |  \- commons-io:commons-io:jar:2.4:compile
[INFO] |  +- org.spark-project:pyrolite:jar:2.0.1:compile
[INFO] |  \- net.sf.py4j:py4j:jar:0.8.1:compile
[INFO] +- org.apache.hadoop:hadoop-client:jar:2.4.0:compile
[INFO] |  +- org.apache.hadoop:hadoop-common:jar:2.4.0:compile
[INFO] |  |  +- org.apache.commons:commons-math3:jar:3.1.1:compile
[INFO] |  |  +- xmlenc:xmlenc:jar:0.52:compile
[INFO] |  |  +- commons-httpclient:commons-httpclient:jar:3.1:compile
[INFO] |  |  +- commons-codec:commons-codec:jar:1.4:compile
[INFO] |  |  +- commons-collections:commons-collections:jar:3.2.1:compile
[INFO] |  |  +- commons-logging:commons-logging:jar:1.1.3:compile
[INFO] |  |  +- commons-lang:commons-lang:jar:2.6:compile
[INFO] |  |  +- commons-configuration:commons-configuration:jar:1.6:compile
[INFO] |  |  |  +- commons-digester:commons-digester:jar:1.8:compile
[INFO] |  |  |  |  \- commons-beanutils:commons-beanutils:jar:1.7.0:compile
[INFO] |  |  |  \-
commons-beanutils:commons-beanutils-core:jar:1.8.0:compile
[INFO] |  |  +- org.codehaus.jackson:jackson-core-asl:jar:1.8.8:compile
[INFO] |  |  +- org.codehaus.jackson:jackson-mapper-asl:jar:1.8.8:compile
[INFO] |  |  +- org.apache.avro:avro:jar:1.7.4:compile
[INFO] |  |  +- com.google.protobuf:protobuf-java:jar:2.5.0:compile
[INFO] |  |  +- org.apache.hadoop:hadoop-auth:jar:2.4.0:compile
[INFO] |  |  |  \- org.apache.httpcomponents:httpclient:jar:4.2.5:compile
[INFO] |  |  |     \- org.apache.httpcomponents:httpcore:jar:4.2.4:compile
[INFO] |  |  \- org.apache.commons:commons-compress:jar:1.4.1:compile
[INFO] |  |     \- org.tukaani:xz:jar:1.0:compile
[INFO] |  +- org.apache.hadoop:hadoop-hdfs:jar:2.4.0:compile
[INFO] |  |  \- org.mortbay.jetty:jetty-util:jar:6.1.26:compile
[INFO] |  +- org.apache.hadoop:hadoop-mapreduce-client-app:jar:2.4.0:compile
[INFO] |  |  +-
org.apache.hadoop:hadoop-mapreduce-client-common:jar:2.4.0:compile
[INFO] |  |  |  +- org.apache.hadoop:hadoop-yarn-client:jar:2.4.0:compile
[INFO] |  |  |  |  \- com.sun.jersey:jersey-client:jar:1.9:compile
[INFO] |  |  |  \-
org.apache.hadoop:hadoop-yarn-server-common:jar:2.4.0:compile
[INFO] |  |  \-
org.apache.hadoop:hadoop-mapreduce-client-shuffle:jar:2.4.0:compile
[INFO] |  +- org.apache.hadoop:hadoop-yarn-api:jar:2.4.0:compile
[INFO] |  +-
org.apache.hadoop:hadoop-mapreduce-client-core:jar:2.4.0:compile
[INFO] |  |  \- org.apache.hadoop:hadoop-yarn-common:jar:2.4.0:compile
[INFO] |  |     +- javax.xml.bind:jaxb-api:jar:2.2.2:compile
[INFO] |  |     |  +- javax.xml.stream:stax-api:jar:1.0-2:compile
[INFO] |  |     |  \- javax.activation:activation:jar:1.1:compile
[INFO] |  |     +- javax.servlet:servlet-api:jar:2.5:compile
[INFO] |  |     \- com.sun.jersey:jersey-core:jar:1.9:compile
[INFO] |  +-
org.apache.hadoop:hadoop-mapreduce-client-jobclient:jar:2.4.0:compile
[INFO] |  \- org.apache.hadoop:hadoop-annotations:jar:2.4.0:compile








--
View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Spark-1-0-0-Maven-dependencies-problems-tp7247p7249.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.

Re: Spark 1.0.0 Maven dependencies problems.

Posted by Sean Owen <so...@cloudera.com>.
On the surface it sounds again like
https://issues.apache.org/jira/browse/SPARK-1949 but not sure it's
exactly the same problem.

The build exclusions are intended to remove dependency on the old
Netty artifact. I think the Maven build has it sorted out though. Are
you using Maven? if so what do you see in mvn dependency:tree -- where
does it turn up?



On Mon, Jun 9, 2014 at 9:34 AM, toivoa <to...@gmail.com> wrote:
> Using
>         <dependency>
>                 <groupId>org.apache.spark</groupId>
>                 <artifactId>spark-core_2.10</artifactId>
>                 <version>1.0.0</version>
>         </dependency>
>
> I can create simple test and run under Eclipse.
> But when I try to deploy on test server I have dependencies problems.
>
> 1. Spark requires
>     <artifactId>akka-remote_2.10</artifactId>
>     <version>2.2.3-shaded-protobuf</version>
>
>       And this in turn requires
>
>         <dependency>
>             <groupId>io.netty</groupId>
>             <artifactId>netty</artifactId>
>             <version>3.6.6.Final</version>
>         </dependency>
>
> 2. At the same time Spark itself requires
>     <artifactId>netty-parent</artifactId>
>     <version>4.0.17.Final</version>
>
> So now I have different Netty versions and I get either
>
> Exception in thread "main" java.lang.SecurityException: class
> "javax.servlet.FilterRegistration"'s signer information does not match
> signer information of other classes in the same package
>
> When using 3.6.6.Final
>
>
> Or
>
> 14/06/09 16:08:10 ERROR ActorSystemImpl: Uncaught fatal error from thread
> [spark-akka.actor.default-dispatcher-4] shutting down ActorSystem [spark]
> java.lang.NoClassDefFoundError: org/jboss/netty/util/Timer
>
> When using 4.0.17.Final
>
>
>
> What I am doing wrong and how to solve problem?
>
> Thanks
> toivo
>
>
>
>
> --
> View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Spark-1-0-0-Maven-dependencies-problems-tp7247.html
> Sent from the Apache Spark User List mailing list archive at Nabble.com.