You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/04 21:05:00 UTC
[jira] [Commented] (SPARK-25335) Skip Zinc downloading if it's
installed in the system
[ https://issues.apache.org/jira/browse/SPARK-25335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16603600#comment-16603600 ]
Apache Spark commented on SPARK-25335:
--------------------------------------
User 'dongjoon-hyun' has created a pull request for this issue:
https://github.com/apache/spark/pull/22333
> Skip Zinc downloading if it's installed in the system
> -----------------------------------------------------
>
> Key: SPARK-25335
> URL: https://issues.apache.org/jira/browse/SPARK-25335
> Project: Spark
> Issue Type: Improvement
> Components: Build
> Affects Versions: 2.4.0
> Reporter: Dongjoon Hyun
> Priority: Minor
>
> Zinc is 23.5MB.
> {code}
> $ curl -LO https://downloads.lightbend.com/zinc/0.3.15/zinc-0.3.15.tgz
> % Total % Received % Xferd Average Speed Time Time Time Current
> Dload Upload Total Spent Left Speed
> 100 23.5M 100 23.5M 0 0 35.4M 0 --:--:-- --:--:-- --:--:-- 35.3M
> {code}
> Currently, Spark downloads Zinc once, but this issue aims to skip Zinc downloading when the system already has it.
> {code}
> $ build/mvn clean
> exec: curl --progress-bar -L https://downloads.lightbend.com/zinc/0.3.15/zinc-0.3.15.tgz
> ######################################################################## 100.0%
> ########################################################################
> {code}
> This will reduce many resources(CPU/Networks/DISK) at least in Mac and Docker-based build system.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org