You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Davies Liu (JIRA)" <ji...@apache.org> on 2014/08/20 21:14:28 UTC

[jira] [Created] (SPARK-3153) shuffle will run out of space when disks have different free space

Davies Liu created SPARK-3153:
---------------------------------

             Summary: shuffle will run out of space when disks have different free space
                 Key: SPARK-3153
                 URL: https://issues.apache.org/jira/browse/SPARK-3153
             Project: Spark
          Issue Type: Bug
            Reporter: Davies Liu


If we have several disks in SPARK_LOCAL_DIRS, and one of them is much smaller than others (maybe added in my mistake, or special disk, SSD), them the shuffle will meet the problem of run out of space with this smaller disk.



--
This message was sent by Atlassian JIRA
(v6.2#6252)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org