You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/01/29 10:17:00 UTC

[jira] [Commented] (SPARK-23253) Only write shuffle temporary index file when there is not an existing one

    [ https://issues.apache.org/jira/browse/SPARK-23253?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16343170#comment-16343170 ] 

Apache Spark commented on SPARK-23253:
--------------------------------------

User 'yaooqinn' has created a pull request for this issue:
https://github.com/apache/spark/pull/20422

> Only write shuffle temporary index file when there is not an existing one
> -------------------------------------------------------------------------
>
>                 Key: SPARK-23253
>                 URL: https://issues.apache.org/jira/browse/SPARK-23253
>             Project: Spark
>          Issue Type: Improvement
>          Components: Shuffle, Spark Core
>    Affects Versions: 2.2.1
>            Reporter: Kent Yao
>            Priority: Major
>
> Shuffle Index temporay file is used for atomic creating shuffle index file, it is not needed when the index file already exists after another attempts of same task had it done.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org