You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@spark.apache.org by Steve Lewis <lo...@gmail.com> on 2014/09/17 23:26:36 UTC

storage.DiskBlockManager: Exception while deleting local spark dir

14/09/17 14:21:21 ERROR storage.DiskBlockManager: Exception while deleting
local spark dir:
C:\Users\Steve\AppData\Local\Temp\spark-local-20140917142115-6a81
java.io.IOException: Failed to delete:
C:\Users\Steve\AppData\Local\Temp\spark-local-20140917142115-6a81\03\shuffle_0_0_10


I run a job with Spark 1.1 involving a mapPartitions. When I add a collect
step to force evaluation I get the above error.

What am I doing wrong? I am running on a local master