You are viewing a plain text version of this content. The canonical link for it is here.
Posted to yarn-issues@hadoop.apache.org by "ASF GitHub Bot (JIRA)" <ji...@apache.org> on 2018/07/06 00:10:00 UTC
[jira] [Commented] (YARN-3929) Uncleaning option for local app log
files with log-aggregation feature
[ https://issues.apache.org/jira/browse/YARN-3929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16534309#comment-16534309 ]
ASF GitHub Bot commented on YARN-3929:
--------------------------------------
GitHub user bschell opened a pull request:
https://github.com/apache/hadoop/pull/401
YARN-3929. Add uncleaning option for local app log file
Add uncleaning option for local app log file with log-aggregation enabled
Support new config to enable/disable local app log file cleanup when log-aggregation is enabled
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/bschell/hadoop bschelle/unclean
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/hadoop/pull/401.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #401
----
commit a92691e1fa63f4615cade05fda2b6a7ddec79fba
Author: Scheller <bs...@...>
Date: 2018-06-29T16:14:02Z
Add uncleaning option for local app log file with log-aggregation enabled
Support new config to enable/disable local app log file cleanup when log-aggregation is enabled
----
> Uncleaning option for local app log files with log-aggregation feature
> ----------------------------------------------------------------------
>
> Key: YARN-3929
> URL: https://issues.apache.org/jira/browse/YARN-3929
> Project: Hadoop YARN
> Issue Type: New Feature
> Components: log-aggregation
> Affects Versions: 2.4.0, 2.6.0
> Reporter: Dongwook Kwon
> Priority: Minor
> Attachments: YARN-3929.02.patch
>
>
> Although it makes sense to delete local app log files once AppLogAggregator copied all files into remote location(HDFS), I have some use cases that need to leave local app log files after it's copied to HDFS. Mostly it's for own backup purpose. I would like to use log-aggregation feature of YARN and want to back up app log files too. Without this option, files has to copy from HDFS to local again.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org