You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Josh Rosen (JIRA)" <ji...@apache.org> on 2015/06/30 06:52:04 UTC

[jira] [Commented] (SPARK-8415) Jenkins compilation spends lots of time re-resolving dependencies and waiting to acquire Ivy cache lock

    [ https://issues.apache.org/jira/browse/SPARK-8415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14607205#comment-14607205 ] 

Josh Rosen commented on SPARK-8415:
-----------------------------------

Here's an example of a build that spent lots of time contended on the lock: https://amplab.cs.berkeley.edu/jenkins/view/Pull%20Request%20Builders/job/SparkPullRequestBuilder/36086/consoleFull

> Jenkins compilation spends lots of time re-resolving dependencies and waiting to acquire Ivy cache lock
> -------------------------------------------------------------------------------------------------------
>
>                 Key: SPARK-8415
>                 URL: https://issues.apache.org/jira/browse/SPARK-8415
>             Project: Spark
>          Issue Type: Bug
>          Components: Build, Project Infra
>            Reporter: Josh Rosen
>
> When watching a pull request build, I noticed that the compilation + packaging + test compilation phases spent huge amounts of time waiting to acquire the Ivy cache lock.  We should see whether we can tell SBT to skip the resolution steps for some of these commands, since this could speed up the compilation process when Jenkins is heavily loaded.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org