You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@spark.apache.org by Egon Kidmose <ki...@gmail.com> on 2013/11/18 03:44:57 UTC

Re: failure notice

Hi All,

I'm trying to get started on using spark, but following the quick
start guide I encounter an error.

As per documentation I run "sbt/sbt assembly" from the root folder,
but I get an error for downloading javax.servlet.orbit. (see below)
It's the same result for 0.8.0 and what's on github.
It seems similar to the issue earlier discussed here:
http://mail-archives.apache.org/mod_mbox/spark-user/201309.mbox/%3CCAJbo4neXyzQe6zGREQJTzZZ5ZrCoAvfEN+WmBYCed6N1EPftxA@mail.gmail.com%3E
I don't understand how to apply this to my problem. (Which *.sbt
should the line be entered into?)

Any advice on how to solve this?
Thanks!

Mvh/BR
Egon Kidmose



~/Downloads/spark-0.8.0-
incubating $ uname -a
Linux ekidmose-laptop-linux 3.8.0-19-generic #30-Ubuntu SMP Wed May 1
16:35:23 UTC 2013 x86_64 x86_64 x86_64 GNU/Linux
 ~/Downloads/spark-0.8.0-incubating $ javac -version
javac 1.7.0_25
 ~/Downloads/spark-0.8.0-incubating $ sbt/sbt assembly
[info] Loading project definition from
/home/ekidmose/Downloads/spark-0.8.0-incubating/project/project
[info] Updating
{file:/home/ekidmose/Downloads/spark-0.8.0-incubating/project/project/}default-8557a6...
[info] Resolving org.scala-sbt#precompiled-2_10_1;0.12.4 ...
[info] Done updating.
[info] Compiling 1 Scala source to
/home/ekidmose/Downloads/spark-0.8.0-incubating/project/project/target/scala-2.9.2/sbt-0.12/classes...
[info] Loading project definition from
/home/ekidmose/Downloads/spark-0.8.0-incubating/project
[info] Updating
{file:/home/ekidmose/Downloads/spark-0.8.0-incubating/project/}plugins...
[info] Resolving org.scala-sbt#precompiled-2_10_1;0.12.4 ...
[info] Done updating.
[info] Compiling 1 Scala source to
/home/ekidmose/Downloads/spark-0.8.0-incubating/project/target/scala-2.9.2/sbt-0.12/classes...
[info] Set current project to root (in build
file:/home/ekidmose/Downloads/spark-0.8.0-incubating/)
[info] Updating {file:/home/ekidmose/Downloads/spark-0.8.0-incubating/}core...
[info] Resolving org.apache.derby#derby;10.4.2.0 ...
[warn]     [NOT FOUND  ]
org.eclipse.jetty.orbit#javax.servlet;2.5.0.v201103041518!javax.servlet.orbit
(77ms)
[warn] ==== public: tried
[warn]   http://repo1.maven.org/maven2/org/eclipse/jetty/orbit/javax.servlet/2.5.0.v201103041518/javax.servlet-2.5.0.v201103041518.orbit
[warn]     ::::::::::::::::::::::::::::::::::::::::::::::
[warn]     ::              FAILED DOWNLOADS            ::
[warn]     :: ^ see resolution messages for details  ^ ::
[warn]     ::::::::::::::::::::::::::::::::::::::::::::::
[warn]     :: org.eclipse.jetty.orbit#javax.servlet;2.5.0.v201103041518!javax.servlet.orbit
[warn]     ::::::::::::::::::::::::::::::::::::::::::::::
sbt.ResolveException: download failed:
org.eclipse.jetty.orbit#javax.servlet;2.5.0.v201103041518!javax.servlet.orbit
    at sbt.IvyActions$.sbt$IvyActions$$resolve(IvyActions.scala:214)
    at sbt.IvyActions$$anonfun$update$1.apply(IvyActions.scala:122)
    at sbt.IvyActions$$anonfun$update$1.apply(IvyActions.scala:121)
    at sbt.IvySbt$Module$$anonfun$withModule$1.apply(Ivy.scala:117)
    at sbt.IvySbt$Module$$anonfun$withModule$1.apply(Ivy.scala:117)
    at sbt.IvySbt$$anonfun$withIvy$1.apply(Ivy.scala:105)
    at sbt.IvySbt.liftedTree1$1(Ivy.scala:52)
    at sbt.IvySbt.action$1(Ivy.scala:52)
    at sbt.IvySbt$$anon$3.call(Ivy.scala:61)
    at xsbt.boot.Locks$GlobalLock.withChannel$1(Locks.scala:75)
    at xsbt.boot.Locks$GlobalLock.withChannelRetries$1(Locks.scala:58)
    at xsbt.boot.Locks$GlobalLock$$anonfun$withFileLock$1.apply(Locks.scala:79)
    at xsbt.boot.Using$.withResource(Using.scala:11)
    at xsbt.boot.Using$.apply(Using.scala:10)
    at xsbt.boot.Locks$GlobalLock.liftedTree1$1(Locks.scala:51)
    at xsbt.boot.Locks$GlobalLock.withLock(Locks.scala:51)
    at xsbt.boot.Locks$.apply0(Locks.scala:30)
    at xsbt.boot.Locks$.apply(Locks.scala:27)
    at sbt.IvySbt.withDefaultLogger(Ivy.scala:61)
    at sbt.IvySbt.withIvy(Ivy.scala:102)
    at sbt.IvySbt.withIvy(Ivy.scala:98)
    at sbt.IvySbt$Module.withModule(Ivy.scala:117)
    at sbt.IvyActions$.update(IvyActions.scala:121)
    at sbt.Classpaths$$anonfun$work$1$1.apply(Defaults.scala:955)
    at sbt.Classpaths$$anonfun$work$1$1.apply(Defaults.scala:953)
    at sbt.Classpaths$$anonfun$doWork$1$1$$anonfun$58.apply(Defaults.scala:976)
    at sbt.Classpaths$$anonfun$doWork$1$1$$anonfun$58.apply(Defaults.scala:974)
    at sbt.Tracked$$anonfun$lastOutput$1.apply(Tracked.scala:35)
    at sbt.Classpaths$$anonfun$doWork$1$1.apply(Defaults.scala:978)
    at sbt.Classpaths$$anonfun$doWork$1$1.apply(Defaults.scala:973)
    at sbt.Tracked$$anonfun$inputChanged$1.apply(Tracked.scala:45)
    at sbt.Classpaths$.cachedUpdate(Defaults.scala:981)
    at sbt.Classpaths$$anonfun$47.apply(Defaults.scala:858)
    at sbt.Classpaths$$anonfun$47.apply(Defaults.scala:855)
    at sbt.Scoped$$anonfun$hf10$1.apply(Structure.scala:586)
    at sbt.Scoped$$anonfun$hf10$1.apply(Structure.scala:586)
    at scala.Function1$$anonfun$compose$1.apply(Function1.scala:49)
    at sbt.Scoped$Reduced$$anonfun$combine$1$$anonfun$apply$12.apply(Structure.scala:311)
    at sbt.Scoped$Reduced$$anonfun$combine$1$$anonfun$apply$12.apply(Structure.scala:311)
    at sbt.$tilde$greater$$anonfun$$u2219$1.apply(TypeFunctions.scala:41)
    at sbt.std.Transform$$anon$5.work(System.scala:71)
    at sbt.Execute$$anonfun$submit$1$$anonfun$apply$1.apply(Execute.scala:232)
    at sbt.Execute$$anonfun$submit$1$$anonfun$apply$1.apply(Execute.scala:232)
    at sbt.ErrorHandling$.wideConvert(ErrorHandling.scala:18)
    at sbt.Execute.work(Execute.scala:238)
    at sbt.Execute$$anonfun$submit$1.apply(Execute.scala:232)
    at sbt.Execute$$anonfun$submit$1.apply(Execute.scala:232)
    at sbt.ConcurrentRestrictions$$anon$4$$anonfun$1.apply(ConcurrentRestrictions.scala:160)
    at sbt.CompletionService$$anon$2.call(CompletionService.scala:30)
    at java.util.concurrent.FutureTask$Sync.innerRun(Unknown Source)
    at java.util.concurrent.FutureTask.run(Unknown Source)
    at java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
    at java.util.concurrent.FutureTask$Sync.innerRun(Unknown Source)
    at java.util.concurrent.FutureTask.run(Unknown Source)
    at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
    at java.lang.Thread.run(Unknown Source)
[error] (core/*:update) sbt.ResolveException: download failed:
org.eclipse.jetty.orbit#javax.servlet;2.5.0.v201103041518!javax.servlet.orbit
[error] Total time: 4 s, completed Nov 17, 2013 6:17:53 PM
 ~/Downloads/spark-0.8.0-incubating $

Re: failure notice

Posted by Aaron Davidson <il...@gmail.com>.
Great, thanks for the update! Your ant version matches mine, though I can't
reproduce the error. Weird.

I have created SPARK-959<https://spark-project.atlassian.net/browse/SPARK-959>to
track this issue and PR
#183 <https://github.com/apache/incubator-spark/pull/183> to hopefully
solve the issue in the future.



On Sun, Nov 17, 2013 at 10:08 PM, Egon Kidmose <ki...@gmail.com> wrote:

> I applied the first approach in $SPARK_HOME/project/SparkBuild.scala
> (.scala, not .sbt, as the later wasn't present)
> This solved the issue.
>
> Thanks for your help!
>
>  ~/Downloads/spark-0.8.0-incubating $ ant -v
> Apache Ant(TM) version 1.8.2 compiled on May 18 2012
> Mvh/BR
> Egon Kidmose
>
>
> On Sun, Nov 17, 2013 at 7:40 PM, Aaron Davidson <il...@gmail.com>
> wrote:
> > Could you report your ant/Ivy version? Just run
> > ant -version
> >
> > The fundamental problem is that Ivy is stupidly thinking ".orbit" is the
> > file extension when it should be ".jar". There are two possible fixes you
> > can try, and please let us know if one or the other works. In
> > $SPARK_HOME/project/SparkBuild.sbt, find the line that contains the text
> > "org.eclipse.jetty" and add this line directly after it:
> > "org.eclipse.jetty.orbit" % "javax.servlet" % "2.5.0.v201103041518"
> > artifacts Artifact("javax.servlet", "jar", "jar"),
> > Hopefully this will force Ivy to do the right thing.
> >
> > If not, you can try the solution from the mailing list in the same file,
> by
> > adding the lines:
> >
> > ivyXML :=
> >   <dependency org="org.eclipse.jetty.orbit" name="javax.servlet"
> > rev="2.5.0.v201103041518">
> >     <artifact name="javax.servlet" type="orbit" ext="jar"/>
> >   </dependency>
> >
> > This solution ideally just does the same thing, albeit in a slightly less
> > SBT-ish way.
> >
> >
> >
> > On Sun, Nov 17, 2013 at 6:44 PM, Egon Kidmose <ki...@gmail.com> wrote:
> >>
> >> Hi All,
> >>
> >> I'm trying to get started on using spark, but following the quick
> >> start guide I encounter an error.
> >>
> >> As per documentation I run "sbt/sbt assembly" from the root folder,
> >> but I get an error for downloading javax.servlet.orbit. (see below)
> >> It's the same result for 0.8.0 and what's on github.
> >> It seems similar to the issue earlier discussed here:
> >>
> >>
> http://mail-archives.apache.org/mod_mbox/spark-user/201309.mbox/%3CCAJbo4neXyzQe6zGREQJTzZZ5ZrCoAvfEN+WmBYCed6N1EPftxA@mail.gmail.com%3E
> >> I don't understand how to apply this to my problem. (Which *.sbt
> >> should the line be entered into?)
> >>
> >> Any advice on how to solve this?
> >> Thanks!
> >>
> >> Mvh/BR
> >> Egon Kidmose
> >>
> >>
> >>
> >> ~/Downloads/spark-0.8.0-
> >> incubating $ uname -a
> >> Linux ekidmose-laptop-linux 3.8.0-19-generic #30-Ubuntu SMP Wed May 1
> >> 16:35:23 UTC 2013 x86_64 x86_64 x86_64 GNU/Linux
> >>  ~/Downloads/spark-0.8.0-incubating $ javac -version
> >> javac 1.7.0_25
> >>  ~/Downloads/spark-0.8.0-incubating $ sbt/sbt assembly
> >> [info] Loading project definition from
> >> /home/ekidmose/Downloads/spark-0.8.0-incubating/project/project
> >> [info] Updating
> >>
> >>
> {file:/home/ekidmose/Downloads/spark-0.8.0-incubating/project/project/}default-8557a6...
> >> [info] Resolving org.scala-sbt#precompiled-2_10_1;0.12.4 ...
> >> [info] Done updating.
> >> [info] Compiling 1 Scala source to
> >>
> >>
> /home/ekidmose/Downloads/spark-0.8.0-incubating/project/project/target/scala-2.9.2/sbt-0.12/classes...
> >> [info] Loading project definition from
> >> /home/ekidmose/Downloads/spark-0.8.0-incubating/project
> >> [info] Updating
> >>
> {file:/home/ekidmose/Downloads/spark-0.8.0-incubating/project/}plugins...
> >> [info] Resolving org.scala-sbt#precompiled-2_10_1;0.12.4 ...
> >> [info] Done updating.
> >> [info] Compiling 1 Scala source to
> >>
> >>
> /home/ekidmose/Downloads/spark-0.8.0-incubating/project/target/scala-2.9.2/sbt-0.12/classes...
> >> [info] Set current project to root (in build
> >> file:/home/ekidmose/Downloads/spark-0.8.0-incubating/)
> >> [info] Updating
> >> {file:/home/ekidmose/Downloads/spark-0.8.0-incubating/}core...
> >> [info] Resolving org.apache.derby#derby;10.4.2.0 ...
> >> [warn]     [NOT FOUND  ]
> >>
> >>
> org.eclipse.jetty.orbit#javax.servlet;2.5.0.v201103041518!javax.servlet.orbit
> >> (77ms)
> >> [warn] ==== public: tried
> >> [warn]
> >>
> http://repo1.maven.org/maven2/org/eclipse/jetty/orbit/javax.servlet/2.5.0.v201103041518/javax.servlet-2.5.0.v201103041518.orbit
> >> [warn]     ::::::::::::::::::::::::::::::::::::::::::::::
> >> [warn]     ::              FAILED DOWNLOADS            ::
> >> [warn]     :: ^ see resolution messages for details  ^ ::
> >> [warn]     ::::::::::::::::::::::::::::::::::::::::::::::
> >> [warn]     ::
> >>
> org.eclipse.jetty.orbit#javax.servlet;2.5.0.v201103041518!javax.servlet.orbit
> >> [warn]     ::::::::::::::::::::::::::::::::::::::::::::::
> >> sbt.ResolveException: download failed:
> >>
> >>
> org.eclipse.jetty.orbit#javax.servlet;2.5.0.v201103041518!javax.servlet.orbit
> >>     at sbt.IvyActions$.sbt$IvyActions$$resolve(IvyActions.scala:214)
> >>     at sbt.IvyActions$$anonfun$update$1.apply(IvyActions.scala:122)
> >>     at sbt.IvyActions$$anonfun$update$1.apply(IvyActions.scala:121)
> >>     at sbt.IvySbt$Module$$anonfun$withModule$1.apply(Ivy.scala:117)
> >>     at sbt.IvySbt$Module$$anonfun$withModule$1.apply(Ivy.scala:117)
> >>     at sbt.IvySbt$$anonfun$withIvy$1.apply(Ivy.scala:105)
> >>     at sbt.IvySbt.liftedTree1$1(Ivy.scala:52)
> >>     at sbt.IvySbt.action$1(Ivy.scala:52)
> >>     at sbt.IvySbt$$anon$3.call(Ivy.scala:61)
> >>     at xsbt.boot.Locks$GlobalLock.withChannel$1(Locks.scala:75)
> >>     at xsbt.boot.Locks$GlobalLock.withChannelRetries$1(Locks.scala:58)
> >>     at
> >> xsbt.boot.Locks$GlobalLock$$anonfun$withFileLock$1.apply(Locks.scala:79)
> >>     at xsbt.boot.Using$.withResource(Using.scala:11)
> >>     at xsbt.boot.Using$.apply(Using.scala:10)
> >>     at xsbt.boot.Locks$GlobalLock.liftedTree1$1(Locks.scala:51)
> >>     at xsbt.boot.Locks$GlobalLock.withLock(Locks.scala:51)
> >>     at xsbt.boot.Locks$.apply0(Locks.scala:30)
> >>     at xsbt.boot.Locks$.apply(Locks.scala:27)
> >>     at sbt.IvySbt.withDefaultLogger(Ivy.scala:61)
> >>     at sbt.IvySbt.withIvy(Ivy.scala:102)
> >>     at sbt.IvySbt.withIvy(Ivy.scala:98)
> >>     at sbt.IvySbt$Module.withModule(Ivy.scala:117)
> >>     at sbt.IvyActions$.update(IvyActions.scala:121)
> >>     at sbt.Classpaths$$anonfun$work$1$1.apply(Defaults.scala:955)
> >>     at sbt.Classpaths$$anonfun$work$1$1.apply(Defaults.scala:953)
> >>     at
> >> sbt.Classpaths$$anonfun$doWork$1$1$$anonfun$58.apply(Defaults.scala:976)
> >>     at
> >> sbt.Classpaths$$anonfun$doWork$1$1$$anonfun$58.apply(Defaults.scala:974)
> >>     at sbt.Tracked$$anonfun$lastOutput$1.apply(Tracked.scala:35)
> >>     at sbt.Classpaths$$anonfun$doWork$1$1.apply(Defaults.scala:978)
> >>     at sbt.Classpaths$$anonfun$doWork$1$1.apply(Defaults.scala:973)
> >>     at sbt.Tracked$$anonfun$inputChanged$1.apply(Tracked.scala:45)
> >>     at sbt.Classpaths$.cachedUpdate(Defaults.scala:981)
> >>     at sbt.Classpaths$$anonfun$47.apply(Defaults.scala:858)
> >>     at sbt.Classpaths$$anonfun$47.apply(Defaults.scala:855)
> >>     at sbt.Scoped$$anonfun$hf10$1.apply(Structure.scala:586)
> >>     at sbt.Scoped$$anonfun$hf10$1.apply(Structure.scala:586)
> >>     at scala.Function1$$anonfun$compose$1.apply(Function1.scala:49)
> >>     at
> >>
> sbt.Scoped$Reduced$$anonfun$combine$1$$anonfun$apply$12.apply(Structure.scala:311)
> >>     at
> >>
> sbt.Scoped$Reduced$$anonfun$combine$1$$anonfun$apply$12.apply(Structure.scala:311)
> >>     at
> sbt.$tilde$greater$$anonfun$$u2219$1.apply(TypeFunctions.scala:41)
> >>     at sbt.std.Transform$$anon$5.work(System.scala:71)
> >>     at
> >> sbt.Execute$$anonfun$submit$1$$anonfun$apply$1.apply(Execute.scala:232)
> >>     at
> >> sbt.Execute$$anonfun$submit$1$$anonfun$apply$1.apply(Execute.scala:232)
> >>     at sbt.ErrorHandling$.wideConvert(ErrorHandling.scala:18)
> >>     at sbt.Execute.work(Execute.scala:238)
> >>     at sbt.Execute$$anonfun$submit$1.apply(Execute.scala:232)
> >>     at sbt.Execute$$anonfun$submit$1.apply(Execute.scala:232)
> >>     at
> >>
> sbt.ConcurrentRestrictions$$anon$4$$anonfun$1.apply(ConcurrentRestrictions.scala:160)
> >>     at sbt.CompletionService$$anon$2.call(CompletionService.scala:30)
> >>     at java.util.concurrent.FutureTask$Sync.innerRun(Unknown Source)
> >>     at java.util.concurrent.FutureTask.run(Unknown Source)
> >>     at java.util.concurrent.Executors$RunnableAdapter.call(Unknown
> Source)
> >>     at java.util.concurrent.FutureTask$Sync.innerRun(Unknown Source)
> >>     at java.util.concurrent.FutureTask.run(Unknown Source)
> >>     at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
> >>     at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown
> Source)
> >>     at java.lang.Thread.run(Unknown Source)
> >> [error] (core/*:update) sbt.ResolveException: download failed:
> >>
> >>
> org.eclipse.jetty.orbit#javax.servlet;2.5.0.v201103041518!javax.servlet.orbit
> >> [error] Total time: 4 s, completed Nov 17, 2013 6:17:53 PM
> >>  ~/Downloads/spark-0.8.0-incubating $
> >
> >
>

Re: failure notice

Posted by Egon Kidmose <ki...@gmail.com>.
I applied the first approach in $SPARK_HOME/project/SparkBuild.scala
(.scala, not .sbt, as the later wasn't present)
This solved the issue.

Thanks for your help!

 ~/Downloads/spark-0.8.0-incubating $ ant -v
Apache Ant(TM) version 1.8.2 compiled on May 18 2012
Mvh/BR
Egon Kidmose


On Sun, Nov 17, 2013 at 7:40 PM, Aaron Davidson <il...@gmail.com> wrote:
> Could you report your ant/Ivy version? Just run
> ant -version
>
> The fundamental problem is that Ivy is stupidly thinking ".orbit" is the
> file extension when it should be ".jar". There are two possible fixes you
> can try, and please let us know if one or the other works. In
> $SPARK_HOME/project/SparkBuild.sbt, find the line that contains the text
> "org.eclipse.jetty" and add this line directly after it:
> "org.eclipse.jetty.orbit" % "javax.servlet" % "2.5.0.v201103041518"
> artifacts Artifact("javax.servlet", "jar", "jar"),
> Hopefully this will force Ivy to do the right thing.
>
> If not, you can try the solution from the mailing list in the same file, by
> adding the lines:
>
> ivyXML :=
>   <dependency org="org.eclipse.jetty.orbit" name="javax.servlet"
> rev="2.5.0.v201103041518">
>     <artifact name="javax.servlet" type="orbit" ext="jar"/>
>   </dependency>
>
> This solution ideally just does the same thing, albeit in a slightly less
> SBT-ish way.
>
>
>
> On Sun, Nov 17, 2013 at 6:44 PM, Egon Kidmose <ki...@gmail.com> wrote:
>>
>> Hi All,
>>
>> I'm trying to get started on using spark, but following the quick
>> start guide I encounter an error.
>>
>> As per documentation I run "sbt/sbt assembly" from the root folder,
>> but I get an error for downloading javax.servlet.orbit. (see below)
>> It's the same result for 0.8.0 and what's on github.
>> It seems similar to the issue earlier discussed here:
>>
>> http://mail-archives.apache.org/mod_mbox/spark-user/201309.mbox/%3CCAJbo4neXyzQe6zGREQJTzZZ5ZrCoAvfEN+WmBYCed6N1EPftxA@mail.gmail.com%3E
>> I don't understand how to apply this to my problem. (Which *.sbt
>> should the line be entered into?)
>>
>> Any advice on how to solve this?
>> Thanks!
>>
>> Mvh/BR
>> Egon Kidmose
>>
>>
>>
>> ~/Downloads/spark-0.8.0-
>> incubating $ uname -a
>> Linux ekidmose-laptop-linux 3.8.0-19-generic #30-Ubuntu SMP Wed May 1
>> 16:35:23 UTC 2013 x86_64 x86_64 x86_64 GNU/Linux
>>  ~/Downloads/spark-0.8.0-incubating $ javac -version
>> javac 1.7.0_25
>>  ~/Downloads/spark-0.8.0-incubating $ sbt/sbt assembly
>> [info] Loading project definition from
>> /home/ekidmose/Downloads/spark-0.8.0-incubating/project/project
>> [info] Updating
>>
>> {file:/home/ekidmose/Downloads/spark-0.8.0-incubating/project/project/}default-8557a6...
>> [info] Resolving org.scala-sbt#precompiled-2_10_1;0.12.4 ...
>> [info] Done updating.
>> [info] Compiling 1 Scala source to
>>
>> /home/ekidmose/Downloads/spark-0.8.0-incubating/project/project/target/scala-2.9.2/sbt-0.12/classes...
>> [info] Loading project definition from
>> /home/ekidmose/Downloads/spark-0.8.0-incubating/project
>> [info] Updating
>> {file:/home/ekidmose/Downloads/spark-0.8.0-incubating/project/}plugins...
>> [info] Resolving org.scala-sbt#precompiled-2_10_1;0.12.4 ...
>> [info] Done updating.
>> [info] Compiling 1 Scala source to
>>
>> /home/ekidmose/Downloads/spark-0.8.0-incubating/project/target/scala-2.9.2/sbt-0.12/classes...
>> [info] Set current project to root (in build
>> file:/home/ekidmose/Downloads/spark-0.8.0-incubating/)
>> [info] Updating
>> {file:/home/ekidmose/Downloads/spark-0.8.0-incubating/}core...
>> [info] Resolving org.apache.derby#derby;10.4.2.0 ...
>> [warn]     [NOT FOUND  ]
>>
>> org.eclipse.jetty.orbit#javax.servlet;2.5.0.v201103041518!javax.servlet.orbit
>> (77ms)
>> [warn] ==== public: tried
>> [warn]
>> http://repo1.maven.org/maven2/org/eclipse/jetty/orbit/javax.servlet/2.5.0.v201103041518/javax.servlet-2.5.0.v201103041518.orbit
>> [warn]     ::::::::::::::::::::::::::::::::::::::::::::::
>> [warn]     ::              FAILED DOWNLOADS            ::
>> [warn]     :: ^ see resolution messages for details  ^ ::
>> [warn]     ::::::::::::::::::::::::::::::::::::::::::::::
>> [warn]     ::
>> org.eclipse.jetty.orbit#javax.servlet;2.5.0.v201103041518!javax.servlet.orbit
>> [warn]     ::::::::::::::::::::::::::::::::::::::::::::::
>> sbt.ResolveException: download failed:
>>
>> org.eclipse.jetty.orbit#javax.servlet;2.5.0.v201103041518!javax.servlet.orbit
>>     at sbt.IvyActions$.sbt$IvyActions$$resolve(IvyActions.scala:214)
>>     at sbt.IvyActions$$anonfun$update$1.apply(IvyActions.scala:122)
>>     at sbt.IvyActions$$anonfun$update$1.apply(IvyActions.scala:121)
>>     at sbt.IvySbt$Module$$anonfun$withModule$1.apply(Ivy.scala:117)
>>     at sbt.IvySbt$Module$$anonfun$withModule$1.apply(Ivy.scala:117)
>>     at sbt.IvySbt$$anonfun$withIvy$1.apply(Ivy.scala:105)
>>     at sbt.IvySbt.liftedTree1$1(Ivy.scala:52)
>>     at sbt.IvySbt.action$1(Ivy.scala:52)
>>     at sbt.IvySbt$$anon$3.call(Ivy.scala:61)
>>     at xsbt.boot.Locks$GlobalLock.withChannel$1(Locks.scala:75)
>>     at xsbt.boot.Locks$GlobalLock.withChannelRetries$1(Locks.scala:58)
>>     at
>> xsbt.boot.Locks$GlobalLock$$anonfun$withFileLock$1.apply(Locks.scala:79)
>>     at xsbt.boot.Using$.withResource(Using.scala:11)
>>     at xsbt.boot.Using$.apply(Using.scala:10)
>>     at xsbt.boot.Locks$GlobalLock.liftedTree1$1(Locks.scala:51)
>>     at xsbt.boot.Locks$GlobalLock.withLock(Locks.scala:51)
>>     at xsbt.boot.Locks$.apply0(Locks.scala:30)
>>     at xsbt.boot.Locks$.apply(Locks.scala:27)
>>     at sbt.IvySbt.withDefaultLogger(Ivy.scala:61)
>>     at sbt.IvySbt.withIvy(Ivy.scala:102)
>>     at sbt.IvySbt.withIvy(Ivy.scala:98)
>>     at sbt.IvySbt$Module.withModule(Ivy.scala:117)
>>     at sbt.IvyActions$.update(IvyActions.scala:121)
>>     at sbt.Classpaths$$anonfun$work$1$1.apply(Defaults.scala:955)
>>     at sbt.Classpaths$$anonfun$work$1$1.apply(Defaults.scala:953)
>>     at
>> sbt.Classpaths$$anonfun$doWork$1$1$$anonfun$58.apply(Defaults.scala:976)
>>     at
>> sbt.Classpaths$$anonfun$doWork$1$1$$anonfun$58.apply(Defaults.scala:974)
>>     at sbt.Tracked$$anonfun$lastOutput$1.apply(Tracked.scala:35)
>>     at sbt.Classpaths$$anonfun$doWork$1$1.apply(Defaults.scala:978)
>>     at sbt.Classpaths$$anonfun$doWork$1$1.apply(Defaults.scala:973)
>>     at sbt.Tracked$$anonfun$inputChanged$1.apply(Tracked.scala:45)
>>     at sbt.Classpaths$.cachedUpdate(Defaults.scala:981)
>>     at sbt.Classpaths$$anonfun$47.apply(Defaults.scala:858)
>>     at sbt.Classpaths$$anonfun$47.apply(Defaults.scala:855)
>>     at sbt.Scoped$$anonfun$hf10$1.apply(Structure.scala:586)
>>     at sbt.Scoped$$anonfun$hf10$1.apply(Structure.scala:586)
>>     at scala.Function1$$anonfun$compose$1.apply(Function1.scala:49)
>>     at
>> sbt.Scoped$Reduced$$anonfun$combine$1$$anonfun$apply$12.apply(Structure.scala:311)
>>     at
>> sbt.Scoped$Reduced$$anonfun$combine$1$$anonfun$apply$12.apply(Structure.scala:311)
>>     at sbt.$tilde$greater$$anonfun$$u2219$1.apply(TypeFunctions.scala:41)
>>     at sbt.std.Transform$$anon$5.work(System.scala:71)
>>     at
>> sbt.Execute$$anonfun$submit$1$$anonfun$apply$1.apply(Execute.scala:232)
>>     at
>> sbt.Execute$$anonfun$submit$1$$anonfun$apply$1.apply(Execute.scala:232)
>>     at sbt.ErrorHandling$.wideConvert(ErrorHandling.scala:18)
>>     at sbt.Execute.work(Execute.scala:238)
>>     at sbt.Execute$$anonfun$submit$1.apply(Execute.scala:232)
>>     at sbt.Execute$$anonfun$submit$1.apply(Execute.scala:232)
>>     at
>> sbt.ConcurrentRestrictions$$anon$4$$anonfun$1.apply(ConcurrentRestrictions.scala:160)
>>     at sbt.CompletionService$$anon$2.call(CompletionService.scala:30)
>>     at java.util.concurrent.FutureTask$Sync.innerRun(Unknown Source)
>>     at java.util.concurrent.FutureTask.run(Unknown Source)
>>     at java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
>>     at java.util.concurrent.FutureTask$Sync.innerRun(Unknown Source)
>>     at java.util.concurrent.FutureTask.run(Unknown Source)
>>     at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
>>     at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
>>     at java.lang.Thread.run(Unknown Source)
>> [error] (core/*:update) sbt.ResolveException: download failed:
>>
>> org.eclipse.jetty.orbit#javax.servlet;2.5.0.v201103041518!javax.servlet.orbit
>> [error] Total time: 4 s, completed Nov 17, 2013 6:17:53 PM
>>  ~/Downloads/spark-0.8.0-incubating $
>
>

Re: failure notice

Posted by Aaron Davidson <il...@gmail.com>.
Could you report your ant/Ivy version? Just run
ant -version

The fundamental problem is that Ivy is stupidly thinking ".orbit" is the
file extension when it should be ".jar". There are two possible fixes you
can try, and please let us know if one or the other works. In
$SPARK_HOME/project/SparkBuild.sbt, find the line that contains the text
"org.eclipse.jetty" and add this line directly after it:
"org.eclipse.jetty.orbit" % "javax.servlet" % "2.5.0.v201103041518"
artifacts Artifact("javax.servlet", "jar", "jar"),
Hopefully this will force Ivy to do the right thing.

If not, you can try the solution from the mailing list in the same file, by
adding the lines:

ivyXML :=
  <dependency org="org.eclipse.jetty.orbit" name="javax.servlet"
rev="2.5.0.v201103041518">
    <artifact name="javax.servlet" type="orbit" ext="jar"/>
  </dependency>

This solution ideally just does the same thing, albeit in a slightly
less SBT-ish way.



On Sun, Nov 17, 2013 at 6:44 PM, Egon Kidmose <ki...@gmail.com> wrote:

> Hi All,
>
> I'm trying to get started on using spark, but following the quick
> start guide I encounter an error.
>
> As per documentation I run "sbt/sbt assembly" from the root folder,
> but I get an error for downloading javax.servlet.orbit. (see below)
> It's the same result for 0.8.0 and what's on github.
> It seems similar to the issue earlier discussed here:
>
> http://mail-archives.apache.org/mod_mbox/spark-user/201309.mbox/%3CCAJbo4neXyzQe6zGREQJTzZZ5ZrCoAvfEN+WmBYCed6N1EPftxA@mail.gmail.com%3E
> I don't understand how to apply this to my problem. (Which *.sbt
> should the line be entered into?)
>
> Any advice on how to solve this?
> Thanks!
>
> Mvh/BR
> Egon Kidmose
>
>
>
> ~/Downloads/spark-0.8.0-
> incubating $ uname -a
> Linux ekidmose-laptop-linux 3.8.0-19-generic #30-Ubuntu SMP Wed May 1
> 16:35:23 UTC 2013 x86_64 x86_64 x86_64 GNU/Linux
>  ~/Downloads/spark-0.8.0-incubating $ javac -version
> javac 1.7.0_25
>  ~/Downloads/spark-0.8.0-incubating $ sbt/sbt assembly
> [info] Loading project definition from
> /home/ekidmose/Downloads/spark-0.8.0-incubating/project/project
> [info] Updating
>
> {file:/home/ekidmose/Downloads/spark-0.8.0-incubating/project/project/}default-8557a6...
> [info] Resolving org.scala-sbt#precompiled-2_10_1;0.12.4 ...
> [info] Done updating.
> [info] Compiling 1 Scala source to
>
> /home/ekidmose/Downloads/spark-0.8.0-incubating/project/project/target/scala-2.9.2/sbt-0.12/classes...
> [info] Loading project definition from
> /home/ekidmose/Downloads/spark-0.8.0-incubating/project
> [info] Updating
> {file:/home/ekidmose/Downloads/spark-0.8.0-incubating/project/}plugins...
> [info] Resolving org.scala-sbt#precompiled-2_10_1;0.12.4 ...
> [info] Done updating.
> [info] Compiling 1 Scala source to
>
> /home/ekidmose/Downloads/spark-0.8.0-incubating/project/target/scala-2.9.2/sbt-0.12/classes...
> [info] Set current project to root (in build
> file:/home/ekidmose/Downloads/spark-0.8.0-incubating/)
> [info] Updating
> {file:/home/ekidmose/Downloads/spark-0.8.0-incubating/}core...
> [info] Resolving org.apache.derby#derby;10.4.2.0 ...
> [warn]     [NOT FOUND  ]
>
> org.eclipse.jetty.orbit#javax.servlet;2.5.0.v201103041518!javax.servlet.orbit
> (77ms)
> [warn] ==== public: tried
> [warn]
> http://repo1.maven.org/maven2/org/eclipse/jetty/orbit/javax.servlet/2.5.0.v201103041518/javax.servlet-2.5.0.v201103041518.orbit
> [warn]     ::::::::::::::::::::::::::::::::::::::::::::::
> [warn]     ::              FAILED DOWNLOADS            ::
> [warn]     :: ^ see resolution messages for details  ^ ::
> [warn]     ::::::::::::::::::::::::::::::::::::::::::::::
> [warn]     ::
> org.eclipse.jetty.orbit#javax.servlet;2.5.0.v201103041518!javax.servlet.orbit
> [warn]     ::::::::::::::::::::::::::::::::::::::::::::::
> sbt.ResolveException: download failed:
>
> org.eclipse.jetty.orbit#javax.servlet;2.5.0.v201103041518!javax.servlet.orbit
>     at sbt.IvyActions$.sbt$IvyActions$$resolve(IvyActions.scala:214)
>     at sbt.IvyActions$$anonfun$update$1.apply(IvyActions.scala:122)
>     at sbt.IvyActions$$anonfun$update$1.apply(IvyActions.scala:121)
>     at sbt.IvySbt$Module$$anonfun$withModule$1.apply(Ivy.scala:117)
>     at sbt.IvySbt$Module$$anonfun$withModule$1.apply(Ivy.scala:117)
>     at sbt.IvySbt$$anonfun$withIvy$1.apply(Ivy.scala:105)
>     at sbt.IvySbt.liftedTree1$1(Ivy.scala:52)
>     at sbt.IvySbt.action$1(Ivy.scala:52)
>     at sbt.IvySbt$$anon$3.call(Ivy.scala:61)
>     at xsbt.boot.Locks$GlobalLock.withChannel$1(Locks.scala:75)
>     at xsbt.boot.Locks$GlobalLock.withChannelRetries$1(Locks.scala:58)
>     at
> xsbt.boot.Locks$GlobalLock$$anonfun$withFileLock$1.apply(Locks.scala:79)
>     at xsbt.boot.Using$.withResource(Using.scala:11)
>     at xsbt.boot.Using$.apply(Using.scala:10)
>     at xsbt.boot.Locks$GlobalLock.liftedTree1$1(Locks.scala:51)
>     at xsbt.boot.Locks$GlobalLock.withLock(Locks.scala:51)
>     at xsbt.boot.Locks$.apply0(Locks.scala:30)
>     at xsbt.boot.Locks$.apply(Locks.scala:27)
>     at sbt.IvySbt.withDefaultLogger(Ivy.scala:61)
>     at sbt.IvySbt.withIvy(Ivy.scala:102)
>     at sbt.IvySbt.withIvy(Ivy.scala:98)
>     at sbt.IvySbt$Module.withModule(Ivy.scala:117)
>     at sbt.IvyActions$.update(IvyActions.scala:121)
>     at sbt.Classpaths$$anonfun$work$1$1.apply(Defaults.scala:955)
>     at sbt.Classpaths$$anonfun$work$1$1.apply(Defaults.scala:953)
>     at
> sbt.Classpaths$$anonfun$doWork$1$1$$anonfun$58.apply(Defaults.scala:976)
>     at
> sbt.Classpaths$$anonfun$doWork$1$1$$anonfun$58.apply(Defaults.scala:974)
>     at sbt.Tracked$$anonfun$lastOutput$1.apply(Tracked.scala:35)
>     at sbt.Classpaths$$anonfun$doWork$1$1.apply(Defaults.scala:978)
>     at sbt.Classpaths$$anonfun$doWork$1$1.apply(Defaults.scala:973)
>     at sbt.Tracked$$anonfun$inputChanged$1.apply(Tracked.scala:45)
>     at sbt.Classpaths$.cachedUpdate(Defaults.scala:981)
>     at sbt.Classpaths$$anonfun$47.apply(Defaults.scala:858)
>     at sbt.Classpaths$$anonfun$47.apply(Defaults.scala:855)
>     at sbt.Scoped$$anonfun$hf10$1.apply(Structure.scala:586)
>     at sbt.Scoped$$anonfun$hf10$1.apply(Structure.scala:586)
>     at scala.Function1$$anonfun$compose$1.apply(Function1.scala:49)
>     at
> sbt.Scoped$Reduced$$anonfun$combine$1$$anonfun$apply$12.apply(Structure.scala:311)
>     at
> sbt.Scoped$Reduced$$anonfun$combine$1$$anonfun$apply$12.apply(Structure.scala:311)
>     at sbt.$tilde$greater$$anonfun$$u2219$1.apply(TypeFunctions.scala:41)
>     at sbt.std.Transform$$anon$5.work(System.scala:71)
>     at
> sbt.Execute$$anonfun$submit$1$$anonfun$apply$1.apply(Execute.scala:232)
>     at
> sbt.Execute$$anonfun$submit$1$$anonfun$apply$1.apply(Execute.scala:232)
>     at sbt.ErrorHandling$.wideConvert(ErrorHandling.scala:18)
>     at sbt.Execute.work(Execute.scala:238)
>     at sbt.Execute$$anonfun$submit$1.apply(Execute.scala:232)
>     at sbt.Execute$$anonfun$submit$1.apply(Execute.scala:232)
>     at
> sbt.ConcurrentRestrictions$$anon$4$$anonfun$1.apply(ConcurrentRestrictions.scala:160)
>     at sbt.CompletionService$$anon$2.call(CompletionService.scala:30)
>     at java.util.concurrent.FutureTask$Sync.innerRun(Unknown Source)
>     at java.util.concurrent.FutureTask.run(Unknown Source)
>     at java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
>     at java.util.concurrent.FutureTask$Sync.innerRun(Unknown Source)
>     at java.util.concurrent.FutureTask.run(Unknown Source)
>     at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
>     at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
>     at java.lang.Thread.run(Unknown Source)
> [error] (core/*:update) sbt.ResolveException: download failed:
>
> org.eclipse.jetty.orbit#javax.servlet;2.5.0.v201103041518!javax.servlet.orbit
> [error] Total time: 4 s, completed Nov 17, 2013 6:17:53 PM
>  ~/Downloads/spark-0.8.0-incubating $
>