You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@spark.apache.org by hadoop user <us...@gmail.com> on 2014/02/22 23:54:16 UTC
standalone spark app build.sbt compilation error
trying to build spark streaming stanalone app and this is how my build.sbt
looks
scalaVersion := "2.10.3"
resolvers += "Sonatype release" at "
https://oss.sonatype.org/content/repositories/releases"
resolvers += "Akka repo" at "http://repo.akka.io/releases/"
resolvers += "Spray repo" at "http://repo.spray.cc"
libraryDependencies += "com.typesafe" % "config" % "1.0.2"
libraryDependencies += "org.spark-project" %% "spark-core" % "0.9.0"
libraryDependencies += "org.spark-project" %% "spark-streaming" % "0.9.0"
am using scala 2.10.3 and spark 0.9.0, not sure what I am missing
sbt/sbt package
[iinfo] Resolving org.fusesource.jansi#jansi;1.4 ...
[warn] ::::::::::::::::::::::::::::::::::::::::::::::
[warn] :: UNRESOLVED DEPENDENCIES ::
[warn] ::::::::::::::::::::::::::::::::::::::::::::::
[warn] :: org.spark-project#spark-core_2.9.3_2.10;0.9.0: not found
[warn] :: org.spark-project#spark-streaming_2.10;0.9.0: not found
[warn] ::::::::::::::::::::::::::::::::::::::::::::::
sbt.ResolveException: unresolved dependency:
org.spark-project#spark-core_2.9.3_2.10;0.9.0: not found
unresolved dependency: org.spark-project#spark-streaming_2.10;0.9.0: not
found
Re: standalone spark app build.sbt compilation error
Posted by Spark Storm <us...@gmail.com>.
Thanks TD - that indeed worked !
On Sat, Feb 22, 2014 at 6:28 PM, Tathagata Das
<ta...@gmail.com>wrote:
> This is what a minimalistic sbt with Spark Streaming would look like
> https://github.com/amplab/training/blob/ampcamp4/streaming/java/build.sbt
> So "0.9.0" should be "0.9.0-incubating"
>
> TD
>
>
> On Sat, Feb 22, 2014 at 2:54 PM, hadoop user <us...@gmail.com>wrote:
>
>> trying to build spark streaming stanalone app and this is how my
>> build.sbt looks
>>
>>
>>
>> scalaVersion := "2.10.3"
>>
>> resolvers += "Sonatype release" at "
>> https://oss.sonatype.org/content/repositories/releases"
>>
>> resolvers += "Akka repo" at "http://repo.akka.io/releases/"
>>
>> resolvers += "Spray repo" at "http://repo.spray.cc"
>>
>> libraryDependencies += "com.typesafe" % "config" % "1.0.2"
>>
>> libraryDependencies += "org.spark-project" %% "spark-core" % "0.9.0"
>>
>> libraryDependencies += "org.spark-project" %% "spark-streaming" % "0.9.0"
>>
>> am using scala 2.10.3 and spark 0.9.0, not sure what I am missing
>>
>> sbt/sbt package
>>
>> [iinfo] Resolving org.fusesource.jansi#jansi;1.4 ...
>> [warn] ::::::::::::::::::::::::::::::::::::::::::::::
>> [warn] :: UNRESOLVED DEPENDENCIES ::
>> [warn] ::::::::::::::::::::::::::::::::::::::::::::::
>> [warn] :: org.spark-project#spark-core_2.9.3_2.10;0.9.0: not found
>> [warn] :: org.spark-project#spark-streaming_2.10;0.9.0: not found
>> [warn] ::::::::::::::::::::::::::::::::::::::::::::::
>> sbt.ResolveException: unresolved dependency:
>> org.spark-project#spark-core_2.9.3_2.10;0.9.0: not found
>> unresolved dependency: org.spark-project#spark-streaming_2.10;0.9.0: not
>> found
>>
>>
>>
>
Re: standalone spark app build.sbt compilation error
Posted by Tathagata Das <ta...@gmail.com>.
This is what a minimalistic sbt with Spark Streaming would look like
https://github.com/amplab/training/blob/ampcamp4/streaming/java/build.sbt
So "0.9.0" should be "0.9.0-incubating"
TD
On Sat, Feb 22, 2014 at 2:54 PM, hadoop user <us...@gmail.com> wrote:
> trying to build spark streaming stanalone app and this is how my build.sbt
> looks
>
>
>
> scalaVersion := "2.10.3"
>
> resolvers += "Sonatype release" at "
> https://oss.sonatype.org/content/repositories/releases"
>
> resolvers += "Akka repo" at "http://repo.akka.io/releases/"
>
> resolvers += "Spray repo" at "http://repo.spray.cc"
>
> libraryDependencies += "com.typesafe" % "config" % "1.0.2"
>
> libraryDependencies += "org.spark-project" %% "spark-core" % "0.9.0"
>
> libraryDependencies += "org.spark-project" %% "spark-streaming" % "0.9.0"
>
> am using scala 2.10.3 and spark 0.9.0, not sure what I am missing
>
> sbt/sbt package
>
> [iinfo] Resolving org.fusesource.jansi#jansi;1.4 ...
> [warn] ::::::::::::::::::::::::::::::::::::::::::::::
> [warn] :: UNRESOLVED DEPENDENCIES ::
> [warn] ::::::::::::::::::::::::::::::::::::::::::::::
> [warn] :: org.spark-project#spark-core_2.9.3_2.10;0.9.0: not found
> [warn] :: org.spark-project#spark-streaming_2.10;0.9.0: not found
> [warn] ::::::::::::::::::::::::::::::::::::::::::::::
> sbt.ResolveException: unresolved dependency:
> org.spark-project#spark-core_2.9.3_2.10;0.9.0: not found
> unresolved dependency: org.spark-project#spark-streaming_2.10;0.9.0: not
> found
>
>
>