You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Tathagata Das (JIRA)" <ji...@apache.org> on 2015/05/29 03:01:17 UTC

[jira] [Created] (SPARK-7930) Shutdown hook deletes rool local dir before SparkContext is stopped, throwing errors

Tathagata Das created SPARK-7930:
------------------------------------

             Summary: Shutdown hook deletes rool local dir before SparkContext is stopped, throwing errors
                 Key: SPARK-7930
                 URL: https://issues.apache.org/jira/browse/SPARK-7930
             Project: Spark
          Issue Type: Bug
          Components: Spark Core, Streaming
            Reporter: Tathagata Das
            Assignee: Tathagata Das


Shutdown hook for temp directories had priority 100 while SparkContext was 50. So the local root directory was deleted before SparkContext was shutdown. This leads to scary errors on running jobs, at the time of shutdown. This is especially a problem when running streaming examples, where Ctrl-C is the only way to  shutdown. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org