[jira] [Created] (SPARK-6735) Provide options to make maximum executor failure count ( which kills the application ) relative to a window duration or disable it.

["Twinkle Sachdeva (JIRA)" <ji...@apache.org>]

Twinkle Sachdeva created SPARK-6735:
---------------------------------------

             Summary: Provide options to make maximum executor failure count ( which kills the application ) relative to a window duration or disable it.
                 Key: SPARK-6735
                 URL: https://issues.apache.org/jira/browse/SPARK-6735
             Project: Spark
          Issue Type: Improvement
          Components: Spark Submit, YARN
    Affects Versions: 1.3.0, 1.2.1, 1.2.0
            Reporter: Twinkle Sachdeva


Currently there is a setting (spark.yarn.max.executor.failures ) which tells maximum number of executor failures, after which Application fails.
For long running applications, user can require not to kill the application at all or will require such setting relative to a window duration. This improvement is ti provide such options to make maximum executor failure count ( which kills the application ) relative to a window duration or disable it.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org