You are viewing a plain text version of this content. The canonical link for it is here.
Posted to yarn-issues@hadoop.apache.org by "Haibo Chen (JIRA)" <ji...@apache.org> on 2017/03/29 23:25:41 UTC
[jira] [Assigned] (YARN-6356) Allow different values of
yarn.log-aggregation.retain-seconds for succeeded and failed jobs
[ https://issues.apache.org/jira/browse/YARN-6356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Haibo Chen reassigned YARN-6356:
--------------------------------
Assignee: Haibo Chen
> Allow different values of yarn.log-aggregation.retain-seconds for succeeded and failed jobs
> -------------------------------------------------------------------------------------------
>
> Key: YARN-6356
> URL: https://issues.apache.org/jira/browse/YARN-6356
> Project: Hadoop YARN
> Issue Type: Improvement
> Components: log-aggregation
> Reporter: Robert Kanter
> Assignee: Haibo Chen
>
> It would be useful to have a value of {{yarn.log-aggregation.retain-seconds}} for succeeded jobs and a different value for failed/killed jobs. For jobs that succeeded, you typically don't care about the logs, so a shorter retention time is fine (and saves space/blocks in HDFS). For jobs that failed or were killed, the logs are much more important, and it's likely to want to keep them around for longer so you have time to look at them.
> For instance, you could set it to keep logs for succeeded jobs for 1 day and logs for failed/killed jobs for 1 week.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org