You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Apache Spark (JIRA)" <ji...@apache.org> on 2016/06/16 17:59:05 UTC

[jira] [Assigned] (SPARK-15990) Support rolling log aggregation for Spark running on YARN

     [ https://issues.apache.org/jira/browse/SPARK-15990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Apache Spark reassigned SPARK-15990:
------------------------------------

    Assignee: Apache Spark

> Support rolling log aggregation for Spark running on YARN
> ---------------------------------------------------------
>
>                 Key: SPARK-15990
>                 URL: https://issues.apache.org/jira/browse/SPARK-15990
>             Project: Spark
>          Issue Type: Improvement
>          Components: YARN
>            Reporter: Saisai Shao
>            Assignee: Apache Spark
>            Priority: Minor
>
> YARN supports rolling log aggregation since version 2.6+, it will aggregate the logs in a timely manner and upload to the HDFS. Compared to the previous log aggregation method which only aggregate the logs after application is finished, this will speed up the log aggregation time. Also this will avoid too large log file problem (out of disk).
> So here propose to introduce this feature for Spark on YARN.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org