[jira] [Created] (SPARK-2019) Spark workers die/disappear when job fails for nearly any reason

["sam (JIRA)" <ji...@apache.org>]

sam created SPARK-2019:
--------------------------

             Summary: Spark workers die/disappear when job fails for nearly any reason
                 Key: SPARK-2019
                 URL: https://issues.apache.org/jira/browse/SPARK-2019
             Project: Spark
          Issue Type: Bug
            Reporter: sam


We either have to reboot all the nodes, or run 'sudo service spark-worker restart' across our cluster.  I don't think this should happen - the job failures are often not even that bad.  There is a 5 upvoted SO question here: http://stackoverflow.com/questions/22031006/spark-0-9-0-worker-keeps-dying-in-standalone-mode-when-job-fails

We shouldn't be giving restart privileges to our devs, and therefore our sysadm has to frequently restart the workers.  When the sysadm is not around, there is nothing our devs can do.

Many thanks



--
This message was sent by Atlassian JIRA
(v6.2#6252)