You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Juliet Hougland (JIRA)" <ji...@apache.org> on 2015/06/25 22:18:06 UTC

[jira] [Created] (SPARK-8642) Ungraceful failure when yarn client is not configured.

Juliet Hougland created SPARK-8642:
--------------------------------------

             Summary: Ungraceful failure when yarn client is not configured.
                 Key: SPARK-8642
                 URL: https://issues.apache.org/jira/browse/SPARK-8642
             Project: Spark
          Issue Type: Bug
          Components: YARN
    Affects Versions: 1.3.1, 1.3.0
            Reporter: Juliet Hougland
            Priority: Minor


When HADOOP_CONF_DIR is not configured (ie yarn-site.xml is not available) the yarn client will try to submit an application. No connection to the resource manager will be able to be established. The client will try to connect 10 times (with a max retry of ten), and then do that 30 more time. This takes about 5 minutes before an Error is recorded for spark context initialization, which is caused by a connect exception. I would expect that after the first 1- tries fail, the initialization of the spark context should fail too. At least that is what I would think given the logs. An earlier failure would be ideal/preferred.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org