You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@bigtop.apache.org by "Jonathan Kelly (JIRA)" <ji...@apache.org> on 2015/03/11 17:52:38 UTC

[jira] [Created] (BIGTOP-1752) Add Zinc to bigtop_toolchain so that it may be used by Spark builds

Jonathan Kelly created BIGTOP-1752:
--------------------------------------

             Summary: Add Zinc to bigtop_toolchain so that it may be used by Spark builds
                 Key: BIGTOP-1752
                 URL: https://issues.apache.org/jira/browse/BIGTOP-1752
             Project: Bigtop
          Issue Type: New Feature
          Components: spark, toolchain
    Affects Versions: 0.8.0
            Reporter: Jonathan Kelly
            Assignee: Jonathan Kelly
            Priority: Minor
             Fix For: 0.9.0


The Zinc Nailgun server can be used to speed up compilation of Scala projects (like Spark) considerably.  For example, building Spark without Zinc running takes about 26 mins in my experience, but with Zinc running it takes only about 14 mins.

This patch causes Zinc to be installed in /usr/local/zinc by the bigtop_toolchain, though it must still be started by whatever process (e.g., Jenkins) executes the build by running "/usr/local/zinc/bin/zinc -start" before kicking off the build.

See https://github.com/typesafehub/zinc and http://spark.apache.org/docs/latest/building-spark.html#speeding-up-compilation-with-zinc for more information about Zinc and using it with a Spark build.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)