You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Patrick Wendell (JIRA)" <ji...@apache.org> on 2015/05/29 07:29:17 UTC
[jira] [Resolved] (SPARK-7930) Shutdown hook deletes rool local dir
before SparkContext is stopped, throwing errors
[ https://issues.apache.org/jira/browse/SPARK-7930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Patrick Wendell resolved SPARK-7930.
------------------------------------
Resolution: Fixed
Fix Version/s: 1.4.0
> Shutdown hook deletes rool local dir before SparkContext is stopped, throwing errors
> ------------------------------------------------------------------------------------
>
> Key: SPARK-7930
> URL: https://issues.apache.org/jira/browse/SPARK-7930
> Project: Spark
> Issue Type: Bug
> Components: Spark Core, Streaming
> Reporter: Tathagata Das
> Assignee: Tathagata Das
> Priority: Critical
> Fix For: 1.4.0
>
>
> Shutdown hook for temp directories had priority 100 while SparkContext was 50. So the local root directory was deleted before SparkContext was shutdown. This leads to scary errors on running jobs, at the time of shutdown. This is especially a problem when running streaming examples, where Ctrl-C is the only way to shutdown.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org