You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Thomas Graves (JIRA)" <ji...@apache.org> on 2016/06/29 13:18:37 UTC
[jira] [Updated] (SPARK-15990) Support rolling log aggregation for
Spark running on YARN
[ https://issues.apache.org/jira/browse/SPARK-15990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Thomas Graves updated SPARK-15990:
----------------------------------
Assignee: Saisai Shao
> Support rolling log aggregation for Spark running on YARN
> ---------------------------------------------------------
>
> Key: SPARK-15990
> URL: https://issues.apache.org/jira/browse/SPARK-15990
> Project: Spark
> Issue Type: Improvement
> Components: YARN
> Reporter: Saisai Shao
> Assignee: Saisai Shao
> Priority: Minor
>
> YARN supports rolling log aggregation since version 2.6+, it will aggregate the logs in a timely manner and upload to the HDFS. Compared to the previous log aggregation method which only aggregate the logs after application is finished, this will speed up the log aggregation time. Also this will avoid too large log file problem (out of disk).
> So here propose to introduce this feature for Spark on YARN.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org