You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Tathagata Das (JIRA)" <ji...@apache.org> on 2015/05/29 03:12:19 UTC

[jira] [Updated] (SPARK-7930) Shutdown hook deletes rool local dir before SparkContext is stopped, throwing errors

     [ https://issues.apache.org/jira/browse/SPARK-7930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Tathagata Das updated SPARK-7930:
---------------------------------
    Priority: Blocker  (was: Major)

> Shutdown hook deletes rool local dir before SparkContext is stopped, throwing errors
> ------------------------------------------------------------------------------------
>
>                 Key: SPARK-7930
>                 URL: https://issues.apache.org/jira/browse/SPARK-7930
>             Project: Spark
>          Issue Type: Bug
>          Components: Spark Core, Streaming
>            Reporter: Tathagata Das
>            Assignee: Tathagata Das
>            Priority: Blocker
>
> Shutdown hook for temp directories had priority 100 while SparkContext was 50. So the local root directory was deleted before SparkContext was shutdown. This leads to scary errors on running jobs, at the time of shutdown. This is especially a problem when running streaming examples, where Ctrl-C is the only way to  shutdown. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org