You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@spark.apache.org by Meisam Fathi <me...@gmail.com> on 2014/06/05 21:36:21 UTC
Building Spark against Scala 2.10.1 virtualized
Hi community,
How should I change sbt to compile spark core with a different version
of Scala? I see maven pom files define dependencies to scala 2.10.4. I
need to override/ignore the maven dependencies and use Scala
virtualized, which needs these lines in a build.sbt file:
scalaOrganization := "org.scala-lang.virtualized"
scalaVersion := "2.10.1"
libraryDependencies += "EPFL" %% "lms" % "0.3-SNAPSHOT"
scalacOptions += "-Yvirtualize"
Thanks,
Meisam
Re: Building Spark against Scala 2.10.1 virtualized
Posted by Reynold Xin <rx...@databricks.com>.
Yes.
On Fri, Jul 18, 2014 at 12:50 PM, Meisam Fathi <me...@gmail.com>
wrote:
> Sorry for resurrecting this thread but project/SparkBuild.scala is
> completely rewritten recently (after this commit
> https://github.com/apache/spark/tree/628932b). Should library
> dependencies be defined in pox.xml files after this commit?
>
> Thanks
> Meisam
>
> On Thu, Jun 5, 2014 at 4:51 PM, Matei Zaharia <ma...@gmail.com>
> wrote:
> > You can modify project/SparkBuild.scala and build Spark with sbt instead
> of Maven.
> >
> >
> > On Jun 5, 2014, at 12:36 PM, Meisam Fathi <me...@gmail.com>
> wrote:
> >
> >> Hi community,
> >>
> >> How should I change sbt to compile spark core with a different version
> >> of Scala? I see maven pom files define dependencies to scala 2.10.4. I
> >> need to override/ignore the maven dependencies and use Scala
> >> virtualized, which needs these lines in a build.sbt file:
> >>
> >> scalaOrganization := "org.scala-lang.virtualized"
> >>
> >> scalaVersion := "2.10.1"
> >>
> >> libraryDependencies += "EPFL" %% "lms" % "0.3-SNAPSHOT"
> >>
> >> scalacOptions += "-Yvirtualize"
> >>
> >>
> >> Thanks,
> >> Meisam
> >
>
Re: Building Spark against Scala 2.10.1 virtualized
Posted by Meisam Fathi <me...@gmail.com>.
Sorry for resurrecting this thread but project/SparkBuild.scala is
completely rewritten recently (after this commit
https://github.com/apache/spark/tree/628932b). Should library
dependencies be defined in pox.xml files after this commit?
Thanks
Meisam
On Thu, Jun 5, 2014 at 4:51 PM, Matei Zaharia <ma...@gmail.com> wrote:
> You can modify project/SparkBuild.scala and build Spark with sbt instead of Maven.
>
>
> On Jun 5, 2014, at 12:36 PM, Meisam Fathi <me...@gmail.com> wrote:
>
>> Hi community,
>>
>> How should I change sbt to compile spark core with a different version
>> of Scala? I see maven pom files define dependencies to scala 2.10.4. I
>> need to override/ignore the maven dependencies and use Scala
>> virtualized, which needs these lines in a build.sbt file:
>>
>> scalaOrganization := "org.scala-lang.virtualized"
>>
>> scalaVersion := "2.10.1"
>>
>> libraryDependencies += "EPFL" %% "lms" % "0.3-SNAPSHOT"
>>
>> scalacOptions += "-Yvirtualize"
>>
>>
>> Thanks,
>> Meisam
>
Re: Building Spark against Scala 2.10.1 virtualized
Posted by Matei Zaharia <ma...@gmail.com>.
You can modify project/SparkBuild.scala and build Spark with sbt instead of Maven.
On Jun 5, 2014, at 12:36 PM, Meisam Fathi <me...@gmail.com> wrote:
> Hi community,
>
> How should I change sbt to compile spark core with a different version
> of Scala? I see maven pom files define dependencies to scala 2.10.4. I
> need to override/ignore the maven dependencies and use Scala
> virtualized, which needs these lines in a build.sbt file:
>
> scalaOrganization := "org.scala-lang.virtualized"
>
> scalaVersion := "2.10.1"
>
> libraryDependencies += "EPFL" %% "lms" % "0.3-SNAPSHOT"
>
> scalacOptions += "-Yvirtualize"
>
>
> Thanks,
> Meisam