You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@spark.apache.org by Gary Struthers <ag...@earthlink.net> on 2013/08/05 23:24:51 UTC

Maven failure building 2.10 branch

Hi,

I want to use the 2.10 branch with Scala-Ide and build with Maven.

First, I needed to add Cloudera's Maven repo to the top level pom to get their hadoop 2 repos.

	<repository>  
	      <id>cloudera</id>
	      <url>https://repository.cloudera.com/artifactory/cloudera-repos/</url>
	</repository>

But then when I try 
mvn -Phadoop2 clean install   or    
mvn -Phadoop1 clean install     or
building in Eclipse. I get these failures and neither the -e or -X options reveal which zip file there was an error opening.

[INFO] Compiling 204 Scala sources and 9 Java sources to /Users/garystruthers/git/incubator-spark/core/target/scala-2.10/classes...
[ERROR] error while loading <root>, error in opening zip file
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO] 
[INFO] Spark Project Parent POM .......................... SUCCESS [1.120s]
[INFO] Spark Project Core ................................ FAILURE [15.817s]
…..
[ERROR] Failed to execute goal net.alchim31.maven:scala-maven-plugin:3.1.0:compile (scala-compile-first) on project spark-core: wrap: scala.reflect.internal.MissingRequirementError: object scala.runtime in compiler mirror not found.

I've tried deleting alchim31, jackson, and scala artifacts from my local maven repository and I downgraded to JDK 6 on OS X

Best,
Gary Struthers

Re: Maven failure building 2.10 branch

Posted by Matei Zaharia <ma...@gmail.com>.
I think the folks at the company sending 2.10 fixes (Imaginea) have been running it for a while, but I'm not sure anyone else has. We decided to hold off on merging Scala 2.10 until Spark 0.8 is released, just to avoid having too many new things in one release. After that we'll merge it in for 0.9.

Matei

On Aug 5, 2013, at 7:34 PM, Stephen Haberman <st...@gmail.com> wrote:

> 
>> Yup, the 2.10 Maven build hasn't been updated in that branch. Mind
>> using SBT for now?
> 
> Speaking of 2.10, is anyone using the 2.10 branch in production?
> 
> Any ETA on merging it? (Sorry, don't mean to nag, just curious.)
> 
> - Stephen
> 


Re: Maven failure building 2.10 branch

Posted by Stephen Haberman <st...@gmail.com>.
> Yup, the 2.10 Maven build hasn't been updated in that branch. Mind
> using SBT for now?

Speaking of 2.10, is anyone using the 2.10 branch in production?

Any ETA on merging it? (Sorry, don't mean to nag, just curious.)

- Stephen


Re: Maven failure building 2.10 branch

Posted by Matei Zaharia <ma...@gmail.com>.
Oh, weird! Good to know that it can be made to work though.

Matei

On Aug 6, 2013, at 5:33 PM, Gary Struthers <ag...@earthlink.net> wrote:

> I re-asked the question on scala-user@googlegroups.com and was told the error message is misleading. It really means there's a bad jar file somewhere. He suggested trying compile option -Ylog-classpath but that didn't tell me anything. So I gave up and deleted the whole m2/repository and, of course, it worked.
> 
> Gary


Re: Maven failure building 2.10 branch

Posted by Gary Struthers <ag...@earthlink.net>.
I re-asked the question on scala-user@googlegroups.com and was told the error message is misleading. It really means there's a bad jar file somewhere. He suggested trying compile option -Ylog-classpath but that didn't tell me anything. So I gave up and deleted the whole m2/repository and, of course, it worked.

Gary

Re: Maven failure building 2.10 branch

Posted by Matei Zaharia <ma...@gmail.com>.
Yup, the 2.10 Maven build hasn't been updated in that branch. Mind using SBT for now?

Matei

On Aug 5, 2013, at 2:24 PM, Gary Struthers <ag...@earthlink.net> wrote:

> Hi,
> 
> I want to use the 2.10 branch with Scala-Ide and build with Maven.
> 
> First, I needed to add Cloudera's Maven repo to the top level pom to get their hadoop 2 repos.
> 
> 	<repository>  
> 	      <id>cloudera</id>
> 	      <url>https://repository.cloudera.com/artifactory/cloudera-repos/</url>
> 	</repository>
> 
> But then when I try 
> mvn -Phadoop2 clean install   or    
> mvn -Phadoop1 clean install     or
> building in Eclipse. I get these failures and neither the -e or -X options reveal which zip file there was an error opening.
> 
> [INFO] Compiling 204 Scala sources and 9 Java sources to /Users/garystruthers/git/incubator-spark/core/target/scala-2.10/classes...
> [ERROR] error while loading <root>, error in opening zip file
> [INFO] ------------------------------------------------------------------------
> [INFO] Reactor Summary:
> [INFO] 
> [INFO] Spark Project Parent POM .......................... SUCCESS [1.120s]
> [INFO] Spark Project Core ................................ FAILURE [15.817s]
> …..
> [ERROR] Failed to execute goal net.alchim31.maven:scala-maven-plugin:3.1.0:compile (scala-compile-first) on project spark-core: wrap: scala.reflect.internal.MissingRequirementError: object scala.runtime in compiler mirror not found.
> 
> I've tried deleting alchim31, jackson, and scala artifacts from my local maven repository and I downgraded to JDK 6 on OS X
> 
> Best,
> Gary Struthers