You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Andrew Or (JIRA)" <ji...@apache.org> on 2015/06/30 02:08:04 UTC
[jira] [Comment Edited] (SPARK-8130) spark.files.useFetchCache
should be off by default
[ https://issues.apache.org/jira/browse/SPARK-8130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14606698#comment-14606698 ]
Andrew Or edited comment on SPARK-8130 at 6/30/15 12:07 AM:
------------------------------------------------------------
See discussion on https://github.com/apache/spark/pull/7051 and SPARK-8716.
was (Author: andrewor14):
See discussion on https://github.com/apache/spark/pull/7051
> spark.files.useFetchCache should be off by default
> --------------------------------------------------
>
> Key: SPARK-8130
> URL: https://issues.apache.org/jira/browse/SPARK-8130
> Project: Spark
> Issue Type: Bug
> Components: Spark Core
> Affects Versions: 1.2.0
> Reporter: Josh Rosen
> Priority: Minor
>
> I noticed that {{spark.files.useFetchCache}} is on by default, but I think that we should turn it off by default since it's unlikely to improve performance for all but a handful of users and adds some extra IO / complexity (albeit only at executor / app startup).
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org