You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Apache Spark (JIRA)" <ji...@apache.org> on 2015/06/27 00:59:05 UTC

[jira] [Commented] (SPARK-8130) spark.files.useFetchCache should be off by default

    [ https://issues.apache.org/jira/browse/SPARK-8130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14603742#comment-14603742 ] 

Apache Spark commented on SPARK-8130:
-------------------------------------

User 'piganesh' has created a pull request for this issue:
https://github.com/apache/spark/pull/7051

> spark.files.useFetchCache should be off by default
> --------------------------------------------------
>
>                 Key: SPARK-8130
>                 URL: https://issues.apache.org/jira/browse/SPARK-8130
>             Project: Spark
>          Issue Type: Bug
>          Components: Spark Core
>            Reporter: Josh Rosen
>            Priority: Minor
>
> I noticed that {{spark.files.useFetchCache}} is on by default, but I think that we should turn it off by default since it's unlikely to improve performance for all but a handful of users and adds some extra IO / complexity (albeit only at executor / app startup).



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org