You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Thomas Graves (JIRA)" <ji...@apache.org> on 2014/09/23 15:47:34 UTC
[jira] [Resolved] (SPARK-2668) Add variable of yarn log directory
for reference from the log4j configuration
[ https://issues.apache.org/jira/browse/SPARK-2668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Thomas Graves resolved SPARK-2668.
----------------------------------
Resolution: Fixed
Fix Version/s: 1.2.0
> Add variable of yarn log directory for reference from the log4j configuration
> -----------------------------------------------------------------------------
>
> Key: SPARK-2668
> URL: https://issues.apache.org/jira/browse/SPARK-2668
> Project: Spark
> Issue Type: Improvement
> Components: YARN
> Affects Versions: 1.0.0
> Reporter: Peng Zhang
> Fix For: 1.2.0
>
>
> Assign value of yarn container log directory to java opts "spark.yarn.log.dir", So user defined log4j.properties can reference this value and write log to YARN container's log directory.
> Otherwise, user defined file appender will only write to container's CWD, and log files in CWD will not be displayed on YARN UIļ¼and either cannot be aggregated to HDFS log directory after job finished.
> User defined log4j.properties reference example:
> {code}
> log4j.appender.rolling_file.File = ${spark.yarn.log.dir}/spark.log
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org