You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/01/29 10:17:00 UTC

[jira] [Assigned] (SPARK-23253) Only write shuffle temporary index file when there is not an existing one

     [ https://issues.apache.org/jira/browse/SPARK-23253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Apache Spark reassigned SPARK-23253:
------------------------------------

    Assignee: Apache Spark

> Only write shuffle temporary index file when there is not an existing one
> -------------------------------------------------------------------------
>
>                 Key: SPARK-23253
>                 URL: https://issues.apache.org/jira/browse/SPARK-23253
>             Project: Spark
>          Issue Type: Improvement
>          Components: Shuffle, Spark Core
>    Affects Versions: 2.2.1
>            Reporter: Kent Yao
>            Assignee: Apache Spark
>            Priority: Major
>
> Shuffle Index temporay file is used for atomic creating shuffle index file, it is not needed when the index file already exists after another attempts of same task had it done.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org