You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Apache Spark (JIRA)" <ji...@apache.org> on 2017/06/06 08:24:18 UTC
[jira] [Commented] (SPARK-20995) 'Spark-env.sh.template' should add
'YARN_CONF_DIR' configuration instructions.
[ https://issues.apache.org/jira/browse/SPARK-20995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16038361#comment-16038361 ]
Apache Spark commented on SPARK-20995:
--------------------------------------
User 'guoxiaolongzte' has created a pull request for this issue:
https://github.com/apache/spark/pull/18212
> 'Spark-env.sh.template' should add 'YARN_CONF_DIR' configuration instructions.
> ------------------------------------------------------------------------------
>
> Key: SPARK-20995
> URL: https://issues.apache.org/jira/browse/SPARK-20995
> Project: Spark
> Issue Type: Improvement
> Components: Spark Core
> Affects Versions: 2.1.1
> Reporter: guoxiaolongzte
> Priority: Minor
>
> Ensure that HADOOP_CONF_DIR or YARN_CONF_DIR points to the directory which contains the (client side) configuration files for the Hadoop cluster.
> These configs are used to write to HDFS and connect to the YARN ResourceManager. The
> configuration contained in this directory will be distributed to the YARN cluster so that all
> containers used by the application use the same configuration.
> Sometimes, HADOOP_CONF_DIR is set to the hdfs configuration file path. So, YARN_CONF_DIR should be set to the yarn configuration file path.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org