'Proper' Build Tool

[Steve Nunez <sn...@hortonworks.com>]

Gents,

It seem that until recently, building via sbt was a documented process in
the 0.9 overview:

http://spark.apache.org/docs/0.9.0/

The section on building mentions using sbt/sbt assembly. However in the
latest overview:

http://spark.apache.org/docs/latest/index.html

There¹s no mention of building with sbt.

What¹s the recommended way to build? What are most people using in their
daily workflow?

Cheers,
- SteveN





-- 
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to 
which it is addressed and may contain information that is confidential, 
privileged and exempt from disclosure under applicable law. If the reader 
of this message is not the intended recipient, you are hereby notified that 
any printing, copying, dissemination, distribution, disclosure or 
forwarding of this communication is strictly prohibited. If you have 
received this communication in error, please contact the sender immediately 
and delete it from your system. Thank You.

Re: 'Proper' Build Tool

[Patrick Wendell <pw...@gmail.com>]

Yeah for packagers we officially recommend using maven. Spark's
dependency graph is very complicated and Maven and SBT use different
conflict resolution strategies, so we've opted to official support
Maven.

SBT is still around though and it's used more often by day-to-day developers.

- Patrick

Re: 'Proper' Build Tool

[Stephen Boesch <ja...@gmail.com>]

Hi Steve,
  I had the opportunity to ask this question at the Summit to Andrew Orr.
 He mentioned that with 1.0 the recommended build tool is with maven. sbt
is however still supported. You will notice that the dependencies are now
completely handled within the maven pom.xml:  the SparkBuild.scala /sbt
reads the dependencies from the pom.xml.

Andrew further suggested to look at the make-distribution.sh to see the
"recommended" way to create builds.  Using mvn on the command line is fine
- but the aforementioned script provides a framework /guideline to set
things up properly.




2014-07-28 13:06 GMT-07:00 Steve Nunez <sn...@hortonworks.com>:

> Gents,
>
> It seem that until recently, building via sbt was a documented process in
> the 0.9 overview:
>
> http://spark.apache.org/docs/0.9.0/
>
> The section on building mentions using sbt/sbt assembly. However in the
> latest overview:
>
> http://spark.apache.org/docs/latest/index.html
>
> There¹s no mention of building with sbt.
>
> What¹s the recommended way to build? What are most people using in their
> daily workflow?
>
> Cheers,
> - SteveN
>
>
>
>
>
> --
> CONFIDENTIALITY NOTICE
> NOTICE: This message is intended for the use of the individual or entity to
> which it is addressed and may contain information that is confidential,
> privileged and exempt from disclosure under applicable law. If the reader
> of this message is not the intended recipient, you are hereby notified that
> any printing, copying, dissemination, distribution, disclosure or
> forwarding of this communication is strictly prohibited. If you have
> received this communication in error, please contact the sender immediately
> and delete it from your system. Thank You.
>