You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@spark.apache.org by Patrick Wendell <pw...@gmail.com> on 2014/12/27 22:44:23 UTC
ANNOUNCE: New build script ./build/mvn
Hi All,
A consistent piece of feedback from Spark developers has been that the
Maven build is very slow. Typesafe provides a tool called Zinc which
improves Scala complication speed substantially with Maven, but is
difficult to install and configure, especially for platforms other
than Mac OS.
I've just merged a patch (authored by Brennon York) that provides an
automatically configured Maven instance with Zinc embedded in Spark.
E.g.:
./build/mvn -Phive -Phive-thriftserver -Pyarn -Phadoop-2.3 package
It is hard to test changes like this across all environments, so
please give this a spin and report any issues on the Spark JIRA. It is
working correctly if you see the following message during compilation:
[INFO] Using zinc server for incremental compilation
Note that developers preferring their own Maven installation are
unaffected by this and can just ignore this new feature.
Cheers,
- Patrick
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@spark.apache.org
For additional commands, e-mail: dev-help@spark.apache.org
Re: ANNOUNCE: New build script ./build/mvn
Posted by Mark Hamstra <ma...@clearstorydata.com>.
>
> Scala complication speed
Heh. I like that.
On Sat, Dec 27, 2014 at 1:51 PM, Nicholas Chammas <
nicholas.chammas@gmail.com> wrote:
> Linkies for the curious:
>
> - SPARK-4501 <https://issues.apache.org/jira/browse/SPARK-4501>: Create
> build/mvn to automatically download maven/zinc/scalac
> - https://github.com/apache/spark/pull/3707
> - New build folder (mvn and sbt):
> https://github.com/apache/spark/tree/master/build
>
> Nick
>
>
> On Sat Dec 27 2014 at 4:46:23 PM Patrick Wendell <pw...@gmail.com>
> wrote:
>
> > Hi All,
> >
> > A consistent piece of feedback from Spark developers has been that the
> > Maven build is very slow. Typesafe provides a tool called Zinc which
> > improves Scala complication speed substantially with Maven, but is
> > difficult to install and configure, especially for platforms other
> > than Mac OS.
> >
> > I've just merged a patch (authored by Brennon York) that provides an
> > automatically configured Maven instance with Zinc embedded in Spark.
> > E.g.:
> >
> > ./build/mvn -Phive -Phive-thriftserver -Pyarn -Phadoop-2.3 package
> >
> > It is hard to test changes like this across all environments, so
> > please give this a spin and report any issues on the Spark JIRA. It is
> > working correctly if you see the following message during compilation:
> >
> > [INFO] Using zinc server for incremental compilation
> >
> > Note that developers preferring their own Maven installation are
> > unaffected by this and can just ignore this new feature.
> >
> > Cheers,
> > - Patrick
> >
> > ---------------------------------------------------------------------
> > To unsubscribe, e-mail: dev-unsubscribe@spark.apache.org
> > For additional commands, e-mail: dev-help@spark.apache.org
> >
> >
>
Re: ANNOUNCE: New build script ./build/mvn
Posted by Nicholas Chammas <ni...@gmail.com>.
Linkies for the curious:
- SPARK-4501 <https://issues.apache.org/jira/browse/SPARK-4501>: Create
build/mvn to automatically download maven/zinc/scalac
- https://github.com/apache/spark/pull/3707
- New build folder (mvn and sbt):
https://github.com/apache/spark/tree/master/build
Nick
On Sat Dec 27 2014 at 4:46:23 PM Patrick Wendell <pw...@gmail.com> wrote:
> Hi All,
>
> A consistent piece of feedback from Spark developers has been that the
> Maven build is very slow. Typesafe provides a tool called Zinc which
> improves Scala complication speed substantially with Maven, but is
> difficult to install and configure, especially for platforms other
> than Mac OS.
>
> I've just merged a patch (authored by Brennon York) that provides an
> automatically configured Maven instance with Zinc embedded in Spark.
> E.g.:
>
> ./build/mvn -Phive -Phive-thriftserver -Pyarn -Phadoop-2.3 package
>
> It is hard to test changes like this across all environments, so
> please give this a spin and report any issues on the Spark JIRA. It is
> working correctly if you see the following message during compilation:
>
> [INFO] Using zinc server for incremental compilation
>
> Note that developers preferring their own Maven installation are
> unaffected by this and can just ignore this new feature.
>
> Cheers,
> - Patrick
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: dev-unsubscribe@spark.apache.org
> For additional commands, e-mail: dev-help@spark.apache.org
>
>