You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@bigtop.apache.org by "Jonathan Kelly (JIRA)" <ji...@apache.org> on 2015/06/10 03:21:00 UTC

[jira] [Commented] (BIGTOP-1752) Add Zinc to bigtop_toolchain so that it may be used by Spark builds

    [ https://issues.apache.org/jira/browse/BIGTOP-1752?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14579828#comment-14579828 ] 

Jonathan Kelly commented on BIGTOP-1752:
----------------------------------------

Sorry for the really slow response. I had been on vacation for a couple weeks around the time you posted this, then I had been temporarily pulled off working on Bigtop for a while after that.

Hmm, I'm not sure why it isn't working for you. My environment is building in Jenkins on an AmazonLinux 2015.03 node with the Bigtop toolchain installed. I don't think I've tried the Spark build with Zinc in a Docker container on AmazonLinux yet. What is your environment?

> Add Zinc to bigtop_toolchain so that it may be used by Spark builds
> -------------------------------------------------------------------
>
>                 Key: BIGTOP-1752
>                 URL: https://issues.apache.org/jira/browse/BIGTOP-1752
>             Project: Bigtop
>          Issue Type: New Feature
>          Components: spark, toolchain
>    Affects Versions: 0.8.0
>            Reporter: Jonathan Kelly
>            Assignee: Jonathan Kelly
>            Priority: Minor
>             Fix For: 1.1.0
>
>         Attachments: BIGTOP-1752.patch, BIGTOP-1752.patch
>
>
> The Zinc Nailgun server can be used to speed up compilation of Scala projects (like Spark) considerably.  For example, building Spark without Zinc running takes about 26 mins in my experience, but with Zinc running it takes only about 14 mins.
> This patch causes Zinc to be installed in /usr/local/zinc by the bigtop_toolchain, though it must still be started by whatever process (e.g., Jenkins) executes the build by running "/usr/local/zinc/bin/zinc -start" before kicking off the build.
> See https://github.com/typesafehub/zinc and http://spark.apache.org/docs/latest/building-spark.html#speeding-up-compilation-with-zinc for more information about Zinc and using it with a Spark build.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)