You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@spark.apache.org by Mikael Ståldal <mi...@magine.com> on 2016/07/22 14:54:59 UTC

Build speed

Is there any way to speed up an incremental build of Spark?

For me it takes 8 minutes to build the project with just a few code changes.

-- 
[image: MagineTV]

*Mikael Ståldal*
Senior software developer

*Magine TV*
mikael.staldal@magine.com
Grev Turegatan 3  | 114 46 Stockholm, Sweden  |   www.magine.com

Privileged and/or Confidential Information may be contained in this
message. If you are not the addressee indicated in this message
(or responsible for delivery of the message to such a person), you may not
copy or deliver this message to anyone. In such case,
you should destroy this message and kindly notify the sender by reply
email.

Re: Build speed

Posted by Ted Yu <yu...@gmail.com>.
I assume you have enabled Zinc.

Cheers

On Fri, Jul 22, 2016 at 7:54 AM, Mikael Ståldal <mi...@magine.com>
wrote:

> Is there any way to speed up an incremental build of Spark?
>
> For me it takes 8 minutes to build the project with just a few code
> changes.
>
> --
> [image: MagineTV]
>
> *Mikael Ståldal*
> Senior software developer
>
> *Magine TV*
> mikael.staldal@magine.com
> Grev Turegatan 3  | 114 46 Stockholm, Sweden  |   www.magine.com
>
> Privileged and/or Confidential Information may be contained in this
> message. If you are not the addressee indicated in this message
> (or responsible for delivery of the message to such a person), you may not
> copy or deliver this message to anyone. In such case,
> you should destroy this message and kindly notify the sender by reply
> email.
>

Re: Build speed

Posted by dhruve ashar <dh...@gmail.com>.
If you are making changes to a specific project, you can just specify it
using -pl in mvn.

Small changes take ~2 mins to build.

On Fri, Jul 22, 2016 at 10:49 AM, Michael Allman <mi...@videoamp.com>
wrote:

> I use sbt. Rebuilds are super fast.
>
> Michael
>
> On Jul 22, 2016, at 7:54 AM, Mikael Ståldal <mi...@magine.com>
> wrote:
>
> Is there any way to speed up an incremental build of Spark?
>
> For me it takes 8 minutes to build the project with just a few code
> changes.
>
> --
> [image: MagineTV]
>
> *Mikael Ståldal*
> Senior software developer
>
> *Magine TV*
> mikael.staldal@magine.com
> Grev Turegatan 3  | 114 46 Stockholm, Sweden  |   www.magine.com
>
> Privileged and/or Confidential Information may be contained in this
> message. If you are not the addressee indicated in this message
> (or responsible for delivery of the message to such a person), you may not
> copy or deliver this message to anyone. In such case,
> you should destroy this message and kindly notify the sender by reply
> email.
>
>
>


-- 
-Dhruve Ashar

Re: Build speed

Posted by Michael Allman <mi...@videoamp.com>.
I use sbt. Rebuilds are super fast.

Michael

> On Jul 22, 2016, at 7:54 AM, Mikael Ståldal <mi...@magine.com> wrote:
> 
> Is there any way to speed up an incremental build of Spark?
> 
> For me it takes 8 minutes to build the project with just a few code changes.
> 
> -- 
>  
> 
> Mikael Ståldal
> Senior software developer 
> 
> Magine TV
> mikael.staldal@magine.com <ma...@magine.com>    
> Grev Turegatan 3  | 114 46 Stockholm, Sweden  |   www.magine.com  <http://www.magine.com/>
> 
> Privileged and/or Confidential Information may be contained in this message. If you are not the addressee indicated in this message
> (or responsible for delivery of the message to such a person), you may not copy or deliver this message to anyone. In such case, 
> you should destroy this message and kindly notify the sender by reply email.