You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@spark.apache.org by mjhb <sp...@mjhb.com> on 2015/04/07 04:20:15 UTC

1.3 Build Error with Scala-2.11

$dev/change-version-to-2.11.sh
$build/mvn -e -DskipTests clean package

[ERROR] Failed to execute goal on project spark-core_2.11: Could not resolve
dependencies for project
org.apache.spark:spark-core_2.11:jar:1.3.2-SNAPSHOT: The following artifacts
could not be resolved:
org.apache.spark:spark-network-common_2.10:jar:1.3.2-SNAPSHOT,
org.apache.spark:spark-network-shuffle_2.10:jar:1.3.2-SNAPSHOT: Failure to
find org.apache.spark:spark-network-common_2.10:jar:1.3.2-SNAPSHOT in
http://repository.apache.org/snapshots was cached in the local repository,
resolution will not be reattempted until the update interval of
apache.snapshots has elapsed or updates are forced -> [Help 1]
org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute
goal on project spark-core_2.11: Could not resolve dependencies for project
org.apache.spark:spark-core_2.11:jar:1.3.2-SNAPSHOT: The following artifacts
could not be resolved:
org.apache.spark:spark-network-common_2.10:jar:1.3.2-SNAPSHOT,
org.apache.spark:spark-network-shuffle_2.10:jar:1.3.2-SNAPSHOT: Failure to
find org.apache.spark:spark-network-common_2.10:jar:1.3.2-SNAPSHOT in
http://repository.apache.org/snapshots was cached in the local repository,
resolution will not be reattempted until the update interval of
apache.snapshots has elapsed or updates are forced
	at
org.apache.maven.lifecycle.internal.LifecycleDependencyResolver.getDependencies(LifecycleDependencyResolver.java:210)
	at
org.apache.maven.lifecycle.internal.LifecycleDependencyResolver.resolveProjectDependencies(LifecycleDependencyResolver.java:117)
	at
org.apache.maven.lifecycle.internal.MojoExecutor.ensureDependenciesAreResolved(MojoExecutor.java:258)
	at
org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:201)
	at
org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153)
	at
org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145)
	at
org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:84)
	at
org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:59)
	at
org.apache.maven.lifecycle.internal.LifecycleStarter.singleThreadedBuild(LifecycleStarter.java:183)
	at
org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:161)
	at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:320)
	at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:156)
	at org.apache.maven.cli.MavenCli.execute(MavenCli.java:537)
	at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:196)
	at org.apache.maven.cli.MavenCli.main(MavenCli.java:141)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at
org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:289)
	at
org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:229)
	at
org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:415)
	at
org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:356)
Caused by: org.apache.maven.project.DependencyResolutionException: Could not
resolve dependencies for project
org.apache.spark:spark-core_2.11:jar:1.3.2-SNAPSHOT: The following artifacts
could not be resolved:
org.apache.spark:spark-network-common_2.10:jar:1.3.2-SNAPSHOT,
org.apache.spark:spark-network-shuffle_2.10:jar:1.3.2-SNAPSHOT: Failure to
find org.apache.spark:spark-network-common_2.10:jar:1.3.2-SNAPSHOT in
http://repository.apache.org/snapshots was cached in the local repository,
resolution will not be reattempted until the update interval of
apache.snapshots has elapsed or updates are forced
	at
org.apache.maven.project.DefaultProjectDependenciesResolver.resolve(DefaultProjectDependenciesResolver.java:189)
	at
org.apache.maven.lifecycle.internal.LifecycleDependencyResolver.getDependencies(LifecycleDependencyResolver.java:185)
	... 22 more
Caused by: org.sonatype.aether.resolution.DependencyResolutionException: The
following artifacts could not be resolved:
org.apache.spark:spark-network-common_2.10:jar:1.3.2-SNAPSHOT,
org.apache.spark:spark-network-shuffle_2.10:jar:1.3.2-SNAPSHOT: Failure to
find org.apache.spark:spark-network-common_2.10:jar:1.3.2-SNAPSHOT in
http://repository.apache.org/snapshots was cached in the local repository,
resolution will not be reattempted until the update interval of
apache.snapshots has elapsed or updates are forced
	at
org.sonatype.aether.impl.internal.DefaultRepositorySystem.resolveDependencies(DefaultRepositorySystem.java:375)
	at
org.apache.maven.project.DefaultProjectDependenciesResolver.resolve(DefaultProjectDependenciesResolver.java:183)
	... 23 more
Caused by: org.sonatype.aether.resolution.ArtifactResolutionException: The
following artifacts could not be resolved:
org.apache.spark:spark-network-common_2.10:jar:1.3.2-SNAPSHOT,
org.apache.spark:spark-network-shuffle_2.10:jar:1.3.2-SNAPSHOT: Failure to
find org.apache.spark:spark-network-common_2.10:jar:1.3.2-SNAPSHOT in
http://repository.apache.org/snapshots was cached in the local repository,
resolution will not be reattempted until the update interval of
apache.snapshots has elapsed or updates are forced
	at
org.sonatype.aether.impl.internal.DefaultArtifactResolver.resolve(DefaultArtifactResolver.java:538)
	at
org.sonatype.aether.impl.internal.DefaultArtifactResolver.resolveArtifacts(DefaultArtifactResolver.java:216)
	at
org.sonatype.aether.impl.internal.DefaultRepositorySystem.resolveDependencies(DefaultRepositorySystem.java:358)
	... 24 more
Caused by: org.sonatype.aether.transfer.ArtifactNotFoundException: Failure
to find org.apache.spark:spark-network-common_2.10:jar:1.3.2-SNAPSHOT in
http://repository.apache.org/snapshots was cached in the local repository,
resolution will not be reattempted until the update interval of
apache.snapshots has elapsed or updates are forced
	at
org.sonatype.aether.impl.internal.DefaultUpdateCheckManager.newException(DefaultUpdateCheckManager.java:230)
	at
org.sonatype.aether.impl.internal.DefaultUpdateCheckManager.checkArtifact(DefaultUpdateCheckManager.java:204)
	at
org.sonatype.aether.impl.internal.DefaultArtifactResolver.resolve(DefaultArtifactResolver.java:427)
	... 26 more




--
View this message in context: http://apache-spark-developers-list.1001551.n3.nabble.com/1-3-Build-Error-with-Scala-2-11-tp11441.html
Sent from the Apache Spark Developers List mailing list archive at Nabble.com.

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@spark.apache.org
For additional commands, e-mail: dev-help@spark.apache.org

Re: 1.3 Build Error with Scala-2.11

Posted by Patrick Wendell <pw...@gmail.com>.
The only think that can persist outside of Spark is if there is still
a live Zinc process. We took care to make sure this was a generally
stateless mechanism.

Both the 1.2.X and 1.3.X releases are built with Scala 2.11 for
packaging purposes. And these have been built as recently as in the
last few days, since we are voting on 1.2.2 and 1.3.1. However there
could be issues that only affect certain environments.

- Patrick

On Mon, Apr 6, 2015 at 11:02 PM, mjhb <sp...@mjhb.com> wrote:
> I resorted to deleting the spark directory between each build earlier today
> (attempting maximum sterility) and then re-cloning from github and switching
> to the 1.2 or 1.3 branch.
>
> Does anything persist outside of the spark directory?
>
> Are you able to build either 1.2 or 1.3 w/ Scala-2.11?
>
>
>
> --
> View this message in context: http://apache-spark-developers-list.1001551.n3.nabble.com/1-3-Build-Error-with-Scala-2-11-tp11441p11447.html
> Sent from the Apache Spark Developers List mailing list archive at Nabble.com.
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: dev-unsubscribe@spark.apache.org
> For additional commands, e-mail: dev-help@spark.apache.org
>

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@spark.apache.org
For additional commands, e-mail: dev-help@spark.apache.org

Re: 1.3 Build Error with Scala-2.11

Posted by Marty Bower <sp...@mjhb.com>.
Yes - ran dev/change-version-to-2.11.sh

But was missing -Dscala-2.11 on mvn command after a -2.10 build. Building
successfully again now after adding that.

On Tue, Apr 7, 2015 at 7:04 PM Imran Rashid <ir...@cloudera.com> wrote:

> did you run
>
> dev/change-version-to-2.11.sh
>
> before compiling?  When I ran this on current master, it mostly worked:
>
> dev/change-version-to-2.11.sh
> mvn -Pyarn -Phadoop-2.4 -Pscala-2.11 -DskipTests clean package
>
> There was a failure in building catalyst, but core built just fine for
> me.  The error I got was:
>
> [INFO]
> ------------------------------------------------------------------------
>
> [INFO] Building Spark Project Catalyst 1.4.0-SNAPSHOT
>
> [INFO]
> ------------------------------------------------------------------------
>
> [WARNING] The POM for org.scalamacros:quasiquotes_2.11:jar:2.0.1 is
> missing, no dependency information available
>
>
> I'm not sure if catalyst is supposed to work w/ scala-2.11 or not ... I
> wouldn't be surprised if the way macros should be used has changed, but its
> not listed explicitly in the docs as being incompatible:
>
>
> http://spark.apache.org/docs/latest/building-spark.html#building-for-scala-211
>
>
>
>
> On Tue, Apr 7, 2015 at 12:00 AM, mjhb <sp...@mjhb.com> wrote:
>
>> I even deleted my local maven repository (.m2) but still stuck when
>> attempting to build w/ Scala-2.11:
>>
> [ERROR] Failed to execute goal on project spark-core_2.11: Could not
>> resolve
>> dependencies for project
>>
> org.apache.spark:spark-core_2.11:jar:1.3.2-SNAPSHOT: The following
>> artifacts
>> could not be resolved:
>
>
>> org.apache.spark:spark-network-common_2.10:jar:1.3.2-SNAPSHOT,
>> org.apache.spark:spark-network-shuffle_2.10:jar:1.3.2-SNAPSHOT: Could not
>> find artifact
>> org.apache.spark:spark-network-common_2.10:jar:1.3.2-SNAPSHOT
>>
> in apache.snapshots (http://repository.apache.org/snapshots) -> [Help 1]
>
>
>> org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute
>> goal on project spark-core_2.11: Could not resolve dependencies for
>> project
>>
> org.apache.spark:spark-core_2.11:jar:1.3.2-SNAPSHOT: The following
>> artifacts
>> could not be resolved:
>
>
>> org.apache.spark:spark-network-common_2.10:jar:1.3.2-SNAPSHOT,
>> org.apache.spark:spark-network-shuffle_2.10:jar:1.3.2-SNAPSHOT: Could not
>> find artifact
>> org.apache.spark:spark-network-common_2.10:jar:1.3.2-SNAPSHOT
>> in apache.snapshots (http://repository.apache.org/snapshots)
>>
>>
>>
>>
>> --
>> View this message in context:
>> http://apache-spark-developers-list.1001551.n3.nabble.com/1-3-Build-Error-with-Scala-2-11-tp11441p11449.html
>
>
>> Sent from the Apache Spark Developers List mailing list archive at
>> Nabble.com.
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: dev-unsubscribe@spark.apache.org
>> For additional commands, e-mail: dev-help@spark.apache.org
>>
>>

Re: 1.3 Build Error with Scala-2.11

Posted by Imran Rashid <ir...@cloudera.com>.
did you run

dev/change-version-to-2.11.sh

before compiling?  When I ran this on current master, it mostly worked:

dev/change-version-to-2.11.sh
mvn -Pyarn -Phadoop-2.4 -Pscala-2.11 -DskipTests clean package

There was a failure in building catalyst, but core built just fine for me.
The error I got was:

[INFO]
------------------------------------------------------------------------

[INFO] Building Spark Project Catalyst 1.4.0-SNAPSHOT

[INFO]
------------------------------------------------------------------------

[WARNING] The POM for org.scalamacros:quasiquotes_2.11:jar:2.0.1 is
missing, no dependency information available


I'm not sure if catalyst is supposed to work w/ scala-2.11 or not ... I
wouldn't be surprised if the way macros should be used has changed, but its
not listed explicitly in the docs as being incompatible:

http://spark.apache.org/docs/latest/building-spark.html#building-for-scala-211




On Tue, Apr 7, 2015 at 12:00 AM, mjhb <sp...@mjhb.com> wrote:

> I even deleted my local maven repository (.m2) but still stuck when
> attempting to build w/ Scala-2.11:
>
> [ERROR] Failed to execute goal on project spark-core_2.11: Could not
> resolve
> dependencies for project
> org.apache.spark:spark-core_2.11:jar:1.3.2-SNAPSHOT: The following
> artifacts
> could not be resolved:
> org.apache.spark:spark-network-common_2.10:jar:1.3.2-SNAPSHOT,
> org.apache.spark:spark-network-shuffle_2.10:jar:1.3.2-SNAPSHOT: Could not
> find artifact org.apache.spark:spark-network-common_2.10:jar:1.3.2-SNAPSHOT
> in apache.snapshots (http://repository.apache.org/snapshots) -> [Help 1]
> org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute
> goal on project spark-core_2.11: Could not resolve dependencies for project
> org.apache.spark:spark-core_2.11:jar:1.3.2-SNAPSHOT: The following
> artifacts
> could not be resolved:
> org.apache.spark:spark-network-common_2.10:jar:1.3.2-SNAPSHOT,
> org.apache.spark:spark-network-shuffle_2.10:jar:1.3.2-SNAPSHOT: Could not
> find artifact org.apache.spark:spark-network-common_2.10:jar:1.3.2-SNAPSHOT
> in apache.snapshots (http://repository.apache.org/snapshots)
>
>
>
>
> --
> View this message in context:
> http://apache-spark-developers-list.1001551.n3.nabble.com/1-3-Build-Error-with-Scala-2-11-tp11441p11449.html
> Sent from the Apache Spark Developers List mailing list archive at
> Nabble.com.
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: dev-unsubscribe@spark.apache.org
> For additional commands, e-mail: dev-help@spark.apache.org
>
>

Re: 1.3 Build Error with Scala-2.11

Posted by Patrick Wendell <pw...@gmail.com>.
Hmm..  Make sure you are building with the right flags. I think you need to
pass -Dscala-2.11 to maven. Take a look at the upstream docs - on my phone
now so can't easily access.
On Apr 7, 2015 1:01 AM, "mjhb" <sp...@mjhb.com> wrote:

> I even deleted my local maven repository (.m2) but still stuck when
> attempting to build w/ Scala-2.11:
>
> [ERROR] Failed to execute goal on project spark-core_2.11: Could not
> resolve
> dependencies for project
> org.apache.spark:spark-core_2.11:jar:1.3.2-SNAPSHOT: The following
> artifacts
> could not be resolved:
> org.apache.spark:spark-network-common_2.10:jar:1.3.2-SNAPSHOT,
> org.apache.spark:spark-network-shuffle_2.10:jar:1.3.2-SNAPSHOT: Could not
> find artifact org.apache.spark:spark-network-common_2.10:jar:1.3.2-SNAPSHOT
> in apache.snapshots (http://repository.apache.org/snapshots) -> [Help 1]
> org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute
> goal on project spark-core_2.11: Could not resolve dependencies for project
> org.apache.spark:spark-core_2.11:jar:1.3.2-SNAPSHOT: The following
> artifacts
> could not be resolved:
> org.apache.spark:spark-network-common_2.10:jar:1.3.2-SNAPSHOT,
> org.apache.spark:spark-network-shuffle_2.10:jar:1.3.2-SNAPSHOT: Could not
> find artifact org.apache.spark:spark-network-common_2.10:jar:1.3.2-SNAPSHOT
> in apache.snapshots (http://repository.apache.org/snapshots)
>
>
>
>
> --
> View this message in context:
> http://apache-spark-developers-list.1001551.n3.nabble.com/1-3-Build-Error-with-Scala-2-11-tp11441p11449.html
> Sent from the Apache Spark Developers List mailing list archive at
> Nabble.com.
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: dev-unsubscribe@spark.apache.org
> For additional commands, e-mail: dev-help@spark.apache.org
>
>

Re: 1.3 Build Error with Scala-2.11

Posted by mjhb <sp...@mjhb.com>.
I even deleted my local maven repository (.m2) but still stuck when
attempting to build w/ Scala-2.11:

[ERROR] Failed to execute goal on project spark-core_2.11: Could not resolve
dependencies for project
org.apache.spark:spark-core_2.11:jar:1.3.2-SNAPSHOT: The following artifacts
could not be resolved:
org.apache.spark:spark-network-common_2.10:jar:1.3.2-SNAPSHOT,
org.apache.spark:spark-network-shuffle_2.10:jar:1.3.2-SNAPSHOT: Could not
find artifact org.apache.spark:spark-network-common_2.10:jar:1.3.2-SNAPSHOT
in apache.snapshots (http://repository.apache.org/snapshots) -> [Help 1]
org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute
goal on project spark-core_2.11: Could not resolve dependencies for project
org.apache.spark:spark-core_2.11:jar:1.3.2-SNAPSHOT: The following artifacts
could not be resolved:
org.apache.spark:spark-network-common_2.10:jar:1.3.2-SNAPSHOT,
org.apache.spark:spark-network-shuffle_2.10:jar:1.3.2-SNAPSHOT: Could not
find artifact org.apache.spark:spark-network-common_2.10:jar:1.3.2-SNAPSHOT
in apache.snapshots (http://repository.apache.org/snapshots)




--
View this message in context: http://apache-spark-developers-list.1001551.n3.nabble.com/1-3-Build-Error-with-Scala-2-11-tp11441p11449.html
Sent from the Apache Spark Developers List mailing list archive at Nabble.com.

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@spark.apache.org
For additional commands, e-mail: dev-help@spark.apache.org

Re: 1.3 Build Error with Scala-2.11

Posted by mjhb <sp...@mjhb.com>.
I resorted to deleting the spark directory between each build earlier today
(attempting maximum sterility) and then re-cloning from github and switching
to the 1.2 or 1.3 branch.

Does anything persist outside of the spark directory?

Are you able to build either 1.2 or 1.3 w/ Scala-2.11?



--
View this message in context: http://apache-spark-developers-list.1001551.n3.nabble.com/1-3-Build-Error-with-Scala-2-11-tp11441p11447.html
Sent from the Apache Spark Developers List mailing list archive at Nabble.com.

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@spark.apache.org
For additional commands, e-mail: dev-help@spark.apache.org

Re: 1.3 Build Error with Scala-2.11

Posted by Patrick Wendell <pw...@gmail.com>.
One thing that I think can cause issues is if you run build/mvn with
Scala 2.10, then try to run it with 2.11, since I think we may store
some downloaded jars relating to zinc that will get screwed up. Not
sure that's what is happening, just an idea.

On Mon, Apr 6, 2015 at 10:54 PM, Patrick Wendell <pw...@gmail.com> wrote:
> The issue is that if you invoke "build/mvn" it will start zinc again
> if it sees that it is killed.
>
> The absolute most "sterile" thing to do is this:
> 1. Kill any zinc processes.
> 2. Clean up spark "git clean -fdx" (WARNING: this will delete any
> staged changes you have, if you have code modifications or extra files
> around)
> 3. Run the 2.11 script to change the versions.
> 4. Run "mvn package" with maven that you installed on your machine.
>
>
> On Mon, Apr 6, 2015 at 10:43 PM, Marty Bower <sp...@mjhb.com> wrote:
>> I'm killing zinc (if it's running) before running each build attempt.
>>
>> Trying to build as "clean" as possible.
>>
>>
>> On Mon, Apr 6, 2015 at 7:31 PM Patrick Wendell <pw...@gmail.com> wrote:
>>>
>>> What if you don't run zinc? I.e. just download maven and run that "mvn
>>> package...". It might take longer, but I wonder if it will work.
>>>
>>> On Mon, Apr 6, 2015 at 10:26 PM, mjhb <sp...@mjhb.com> wrote:
>>> > Similar problem on 1.2 branch:
>>> >
>>> > [ERROR] Failed to execute goal on project spark-core_2.11: Could not
>>> > resolve
>>> > dependencies for project
>>> > org.apache.spark:spark-core_2.11:jar:1.2.3-SNAPSHOT: The following
>>> > artifacts
>>> > could not be resolved:
>>> > org.apache.spark:spark-network-common_2.10:jar:1.2.3-SNAPSHOT,
>>> > org.apache.spark:spark-network-shuffle_2.10:jar:1.2.3-SNAPSHOT: Failure
>>> > to
>>> > find org.apache.spark:spark-network-common_2.10:jar:1.2.3-SNAPSHOT in
>>> > http://repository.apache.org/snapshots was cached in the local
>>> > repository,
>>> > resolution will not be reattempted until the update interval of
>>> > apache.snapshots has elapsed or updates are forced -> [Help 1]
>>> > org.apache.maven.lifecycle.LifecycleExecutionException: Failed to
>>> > execute
>>> > goal on project spark-core_2.11: Could not resolve dependencies for
>>> > project
>>> > org.apache.spark:spark-core_2.11:jar:1.2.3-SNAPSHOT: The following
>>> > artifacts
>>> > could not be resolved:
>>> > org.apache.spark:spark-network-common_2.10:jar:1.2.3-SNAPSHOT,
>>> > org.apache.spark:spark-network-shuffle_2.10:jar:1.2.3-SNAPSHOT: Failure
>>> > to
>>> > find org.apache.spark:spark-network-common_2.10:jar:1.2.3-SNAPSHOT in
>>> > http://repository.apache.org/snapshots was cached in the local
>>> > repository,
>>> > resolution will not be reattempted until the update interval of
>>> > apache.snapshots has elapsed or updates are forced
>>> >
>>> >
>>> >
>>> >
>>> > --
>>> > View this message in context:
>>> > http://apache-spark-developers-list.1001551.n3.nabble.com/1-3-Build-Error-with-Scala-2-11-tp11441p11442.html
>>> > Sent from the Apache Spark Developers List mailing list archive at
>>> > Nabble.com.
>>> >
>>> > ---------------------------------------------------------------------
>>> > To unsubscribe, e-mail: dev-unsubscribe@spark.apache.org
>>> > For additional commands, e-mail: dev-help@spark.apache.org
>>> >

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@spark.apache.org
For additional commands, e-mail: dev-help@spark.apache.org

Re: 1.3 Build Error with Scala-2.11

Posted by Patrick Wendell <pw...@gmail.com>.
The issue is that if you invoke "build/mvn" it will start zinc again
if it sees that it is killed.

The absolute most "sterile" thing to do is this:
1. Kill any zinc processes.
2. Clean up spark "git clean -fdx" (WARNING: this will delete any
staged changes you have, if you have code modifications or extra files
around)
3. Run the 2.11 script to change the versions.
4. Run "mvn package" with maven that you installed on your machine.


On Mon, Apr 6, 2015 at 10:43 PM, Marty Bower <sp...@mjhb.com> wrote:
> I'm killing zinc (if it's running) before running each build attempt.
>
> Trying to build as "clean" as possible.
>
>
> On Mon, Apr 6, 2015 at 7:31 PM Patrick Wendell <pw...@gmail.com> wrote:
>>
>> What if you don't run zinc? I.e. just download maven and run that "mvn
>> package...". It might take longer, but I wonder if it will work.
>>
>> On Mon, Apr 6, 2015 at 10:26 PM, mjhb <sp...@mjhb.com> wrote:
>> > Similar problem on 1.2 branch:
>> >
>> > [ERROR] Failed to execute goal on project spark-core_2.11: Could not
>> > resolve
>> > dependencies for project
>> > org.apache.spark:spark-core_2.11:jar:1.2.3-SNAPSHOT: The following
>> > artifacts
>> > could not be resolved:
>> > org.apache.spark:spark-network-common_2.10:jar:1.2.3-SNAPSHOT,
>> > org.apache.spark:spark-network-shuffle_2.10:jar:1.2.3-SNAPSHOT: Failure
>> > to
>> > find org.apache.spark:spark-network-common_2.10:jar:1.2.3-SNAPSHOT in
>> > http://repository.apache.org/snapshots was cached in the local
>> > repository,
>> > resolution will not be reattempted until the update interval of
>> > apache.snapshots has elapsed or updates are forced -> [Help 1]
>> > org.apache.maven.lifecycle.LifecycleExecutionException: Failed to
>> > execute
>> > goal on project spark-core_2.11: Could not resolve dependencies for
>> > project
>> > org.apache.spark:spark-core_2.11:jar:1.2.3-SNAPSHOT: The following
>> > artifacts
>> > could not be resolved:
>> > org.apache.spark:spark-network-common_2.10:jar:1.2.3-SNAPSHOT,
>> > org.apache.spark:spark-network-shuffle_2.10:jar:1.2.3-SNAPSHOT: Failure
>> > to
>> > find org.apache.spark:spark-network-common_2.10:jar:1.2.3-SNAPSHOT in
>> > http://repository.apache.org/snapshots was cached in the local
>> > repository,
>> > resolution will not be reattempted until the update interval of
>> > apache.snapshots has elapsed or updates are forced
>> >
>> >
>> >
>> >
>> > --
>> > View this message in context:
>> > http://apache-spark-developers-list.1001551.n3.nabble.com/1-3-Build-Error-with-Scala-2-11-tp11441p11442.html
>> > Sent from the Apache Spark Developers List mailing list archive at
>> > Nabble.com.
>> >
>> > ---------------------------------------------------------------------
>> > To unsubscribe, e-mail: dev-unsubscribe@spark.apache.org
>> > For additional commands, e-mail: dev-help@spark.apache.org
>> >

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@spark.apache.org
For additional commands, e-mail: dev-help@spark.apache.org

Re: 1.3 Build Error with Scala-2.11

Posted by Marty Bower <sp...@mjhb.com>.
I'm killing zinc (if it's running) before running each build attempt.

Trying to build as "clean" as possible.


On Mon, Apr 6, 2015 at 7:31 PM Patrick Wendell <pw...@gmail.com> wrote:

> What if you don't run zinc? I.e. just download maven and run that "mvn
> package...". It might take longer, but I wonder if it will work.
>
> On Mon, Apr 6, 2015 at 10:26 PM, mjhb <sp...@mjhb.com> wrote:
> > Similar problem on 1.2 branch:
> >
> > [ERROR] Failed to execute goal on project spark-core_2.11: Could not
> resolve
> > dependencies for project
> > org.apache.spark:spark-core_2.11:jar:1.2.3-SNAPSHOT: The following
> artifacts
> > could not be resolved:
> > org.apache.spark:spark-network-common_2.10:jar:1.2.3-SNAPSHOT,
> > org.apache.spark:spark-network-shuffle_2.10:jar:1.2.3-SNAPSHOT: Failure
> to
> > find org.apache.spark:spark-network-common_2.10:jar:1.2.3-SNAPSHOT in
> > http://repository.apache.org/snapshots was cached in the local
> repository,
> > resolution will not be reattempted until the update interval of
> > apache.snapshots has elapsed or updates are forced -> [Help 1]
> > org.apache.maven.lifecycle.LifecycleExecutionException: Failed to
> execute
> > goal on project spark-core_2.11: Could not resolve dependencies for
> project
> > org.apache.spark:spark-core_2.11:jar:1.2.3-SNAPSHOT: The following
> artifacts
> > could not be resolved:
> > org.apache.spark:spark-network-common_2.10:jar:1.2.3-SNAPSHOT,
> > org.apache.spark:spark-network-shuffle_2.10:jar:1.2.3-SNAPSHOT: Failure
> to
> > find org.apache.spark:spark-network-common_2.10:jar:1.2.3-SNAPSHOT in
> > http://repository.apache.org/snapshots was cached in the local
> repository,
> > resolution will not be reattempted until the update interval of
> > apache.snapshots has elapsed or updates are forced
> >
> >
> >
> >
> > --
> > View this message in context: http://apache-spark-
> developers-list.1001551.n3.nabble.com/1-3-Build-Error-
> with-Scala-2-11-tp11441p11442.html
> > Sent from the Apache Spark Developers List mailing list archive at
> Nabble.com.
> >
> > ---------------------------------------------------------------------
> > To unsubscribe, e-mail: dev-unsubscribe@spark.apache.org
> > For additional commands, e-mail: dev-help@spark.apache.org
> >
>

Re: 1.3 Build Error with Scala-2.11

Posted by Patrick Wendell <pw...@gmail.com>.
What if you don't run zinc? I.e. just download maven and run that "mvn
package...". It might take longer, but I wonder if it will work.

On Mon, Apr 6, 2015 at 10:26 PM, mjhb <sp...@mjhb.com> wrote:
> Similar problem on 1.2 branch:
>
> [ERROR] Failed to execute goal on project spark-core_2.11: Could not resolve
> dependencies for project
> org.apache.spark:spark-core_2.11:jar:1.2.3-SNAPSHOT: The following artifacts
> could not be resolved:
> org.apache.spark:spark-network-common_2.10:jar:1.2.3-SNAPSHOT,
> org.apache.spark:spark-network-shuffle_2.10:jar:1.2.3-SNAPSHOT: Failure to
> find org.apache.spark:spark-network-common_2.10:jar:1.2.3-SNAPSHOT in
> http://repository.apache.org/snapshots was cached in the local repository,
> resolution will not be reattempted until the update interval of
> apache.snapshots has elapsed or updates are forced -> [Help 1]
> org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute
> goal on project spark-core_2.11: Could not resolve dependencies for project
> org.apache.spark:spark-core_2.11:jar:1.2.3-SNAPSHOT: The following artifacts
> could not be resolved:
> org.apache.spark:spark-network-common_2.10:jar:1.2.3-SNAPSHOT,
> org.apache.spark:spark-network-shuffle_2.10:jar:1.2.3-SNAPSHOT: Failure to
> find org.apache.spark:spark-network-common_2.10:jar:1.2.3-SNAPSHOT in
> http://repository.apache.org/snapshots was cached in the local repository,
> resolution will not be reattempted until the update interval of
> apache.snapshots has elapsed or updates are forced
>
>
>
>
> --
> View this message in context: http://apache-spark-developers-list.1001551.n3.nabble.com/1-3-Build-Error-with-Scala-2-11-tp11441p11442.html
> Sent from the Apache Spark Developers List mailing list archive at Nabble.com.
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: dev-unsubscribe@spark.apache.org
> For additional commands, e-mail: dev-help@spark.apache.org
>

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@spark.apache.org
For additional commands, e-mail: dev-help@spark.apache.org

Re: 1.3 Build Error with Scala-2.11

Posted by mjhb <sp...@mjhb.com>.
Similar problem on 1.2 branch:

[ERROR] Failed to execute goal on project spark-core_2.11: Could not resolve
dependencies for project
org.apache.spark:spark-core_2.11:jar:1.2.3-SNAPSHOT: The following artifacts
could not be resolved:
org.apache.spark:spark-network-common_2.10:jar:1.2.3-SNAPSHOT,
org.apache.spark:spark-network-shuffle_2.10:jar:1.2.3-SNAPSHOT: Failure to
find org.apache.spark:spark-network-common_2.10:jar:1.2.3-SNAPSHOT in
http://repository.apache.org/snapshots was cached in the local repository,
resolution will not be reattempted until the update interval of
apache.snapshots has elapsed or updates are forced -> [Help 1]
org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute
goal on project spark-core_2.11: Could not resolve dependencies for project
org.apache.spark:spark-core_2.11:jar:1.2.3-SNAPSHOT: The following artifacts
could not be resolved:
org.apache.spark:spark-network-common_2.10:jar:1.2.3-SNAPSHOT,
org.apache.spark:spark-network-shuffle_2.10:jar:1.2.3-SNAPSHOT: Failure to
find org.apache.spark:spark-network-common_2.10:jar:1.2.3-SNAPSHOT in
http://repository.apache.org/snapshots was cached in the local repository,
resolution will not be reattempted until the update interval of
apache.snapshots has elapsed or updates are forced




--
View this message in context: http://apache-spark-developers-list.1001551.n3.nabble.com/1-3-Build-Error-with-Scala-2-11-tp11441p11442.html
Sent from the Apache Spark Developers List mailing list archive at Nabble.com.

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@spark.apache.org
For additional commands, e-mail: dev-help@spark.apache.org