You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Apache Spark (JIRA)" <ji...@apache.org> on 2014/10/05 08:45:34 UTC

[jira] [Commented] (SPARK-3801) Make app dir cleanup more efficient

    [ https://issues.apache.org/jira/browse/SPARK-3801?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14159458#comment-14159458 ] 

Apache Spark commented on SPARK-3801:
-------------------------------------

User 'viirya' has created a pull request for this issue:
https://github.com/apache/spark/pull/2660

> Make app dir cleanup more efficient
> -----------------------------------
>
>                 Key: SPARK-3801
>                 URL: https://issues.apache.org/jira/browse/SPARK-3801
>             Project: Spark
>          Issue Type: Improvement
>            Reporter: Liang-Chi Hsieh
>            Priority: Minor
>
> The newly merged more conservative app directory cleanup can be more efficient. Since it is not needed to store newer files, using 'exists' instead of 'filter' can be more efficient because redundant items are skipped.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org