You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-issues@hadoop.apache.org by "Thomas Graves (JIRA)" <ji...@apache.org> on 2011/07/27 15:41:09 UTC
[jira] [Created] (MAPREDUCE-2735) MR279: finished applications
should be added to an application summary log
MR279: finished applications should be added to an application summary log
--------------------------------------------------------------------------
Key: MAPREDUCE-2735
URL: https://issues.apache.org/jira/browse/MAPREDUCE-2735
Project: Hadoop Map/Reduce
Issue Type: Bug
Components: mrv2
Reporter: Thomas Graves
Assignee: Thomas Graves
When an application finishes it should be added to an application summary log for historical purposes. jira MAPREDUCE-2649 is going to start purging applications from RM when certain limits are hit which makes this more critical. We also need to save the information early enough after the app finishes so we don't lose the info if the RM does get restarted.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-2735) MR279: finished applications
should be added to an application summary log
Posted by "Thomas Graves (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Thomas Graves updated MAPREDUCE-2735:
-------------------------------------
Attachment: MAPREDUCE-2735-v2.patch
added example to common log4j.properties. Hopefully it doesn't complain since its in common and not mapreduce directory.
> MR279: finished applications should be added to an application summary log
> --------------------------------------------------------------------------
>
> Key: MAPREDUCE-2735
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2735
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Reporter: Thomas Graves
> Assignee: Thomas Graves
> Fix For: 0.23.0, 0.24.0
>
> Attachments: MAPREDUCE-2735-v2.patch, MAPREDUCE-2735.patch
>
>
> When an application finishes it should be added to an application summary log for historical purposes. jira MAPREDUCE-2649 is going to start purging applications from RM when certain limits are hit which makes this more critical. We also need to save the information early enough after the app finishes so we don't lose the info if the RM does get restarted.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-2735) MR279: finished applications
should be added to an application summary log
Posted by "Thomas Graves (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13095593#comment-13095593 ]
Thomas Graves commented on MAPREDUCE-2735:
------------------------------------------
Thanks Arun. Sure I can add an example, you want it in the one at ./hadoop-common-project/hadoop-common/src/main/conf/log4j.properties?
> MR279: finished applications should be added to an application summary log
> --------------------------------------------------------------------------
>
> Key: MAPREDUCE-2735
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2735
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Reporter: Thomas Graves
> Assignee: Thomas Graves
> Fix For: 0.23.0, 0.24.0
>
> Attachments: MAPREDUCE-2735.patch
>
>
> When an application finishes it should be added to an application summary log for historical purposes. jira MAPREDUCE-2649 is going to start purging applications from RM when certain limits are hit which makes this more critical. We also need to save the information early enough after the app finishes so we don't lose the info if the RM does get restarted.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-2735) MR279: finished applications
should be added to an application summary log
Posted by "Arun C Murthy (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Arun C Murthy updated MAPREDUCE-2735:
-------------------------------------
Resolution: Fixed
Fix Version/s: (was: 0.24.0)
Status: Resolved (was: Patch Available)
I just committed this. Thanks Tom!
> MR279: finished applications should be added to an application summary log
> --------------------------------------------------------------------------
>
> Key: MAPREDUCE-2735
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2735
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Reporter: Thomas Graves
> Assignee: Thomas Graves
> Fix For: 0.23.0
>
> Attachments: MAPREDUCE-2735-v2.patch, MAPREDUCE-2735.patch
>
>
> When an application finishes it should be added to an application summary log for historical purposes. jira MAPREDUCE-2649 is going to start purging applications from RM when certain limits are hit which makes this more critical. We also need to save the information early enough after the app finishes so we don't lose the info if the RM does get restarted.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-2735) MR279: finished applications
should be added to an application summary log
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13095958#comment-13095958 ]
Hudson commented on MAPREDUCE-2735:
-----------------------------------
Integrated in Hadoop-Mapreduce-trunk #804 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk/804/])
MAPREDUCE-2735. Add an applications summary log to ResourceManager. Contributed by Thomas Graves.
acmurthy : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1164301
Files :
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/conf/log4j.properties
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/RMAppManager.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/rmapp/MockRMApp.java
> MR279: finished applications should be added to an application summary log
> --------------------------------------------------------------------------
>
> Key: MAPREDUCE-2735
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2735
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Reporter: Thomas Graves
> Assignee: Thomas Graves
> Fix For: 0.23.0
>
> Attachments: MAPREDUCE-2735-v2.patch, MAPREDUCE-2735.patch
>
>
> When an application finishes it should be added to an application summary log for historical purposes. jira MAPREDUCE-2649 is going to start purging applications from RM when certain limits are hit which makes this more critical. We also need to save the information early enough after the app finishes so we don't lose the info if the RM does get restarted.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-2735) MR279: finished applications
should be added to an application summary log
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13095807#comment-13095807 ]
Hudson commented on MAPREDUCE-2735:
-----------------------------------
Integrated in Hadoop-Hdfs-trunk-Commit #900 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk-Commit/900/])
MAPREDUCE-2735. Add an applications summary log to ResourceManager. Contributed by Thomas Graves.
acmurthy : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1164301
Files :
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/conf/log4j.properties
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/RMAppManager.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/rmapp/MockRMApp.java
> MR279: finished applications should be added to an application summary log
> --------------------------------------------------------------------------
>
> Key: MAPREDUCE-2735
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2735
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Reporter: Thomas Graves
> Assignee: Thomas Graves
> Fix For: 0.23.0
>
> Attachments: MAPREDUCE-2735-v2.patch, MAPREDUCE-2735.patch
>
>
> When an application finishes it should be added to an application summary log for historical purposes. jira MAPREDUCE-2649 is going to start purging applications from RM when certain limits are hit which makes this more critical. We also need to save the information early enough after the app finishes so we don't lose the info if the RM does get restarted.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-2735) MR279: finished applications
should be added to an application summary log
Posted by "Thomas Graves (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13094649#comment-13094649 ]
Thomas Graves commented on MAPREDUCE-2735:
------------------------------------------
The application summary log is formatted the same as the old job summary log. example output is:
2011-08-31 16:02:01,237 INFO resourcemanager.RMAppManager$ApplicationSummary: appId=application_1314806486924_1,name=word count,user=user1,queue=default,state=FINISHED,trackingUrl=99.99.99.99:19888/yarn/job/job_1314806486924_1_1,appMasterHost=99.99.99.99,startTime=1314806497546,finishTime=1314806521231
To configured would be something like this:
rm.appsummary.logger=INFO,RMSUMMARY
log4j.logger.org.apache.hadoop.yarn.server.resourcemanager.RMAppManager$ApplicationSummary=${rm.appsummary.logger}
log4j.additivity.org.apache.hadoop.yarn.server.resourcemanager.RMAppManager$ApplicationSummary=false
log4j.appender.RMSUMMARY=org.apache.log4j.DailyRollingFileAppender
log4j.appender.RMSUMMARY.File=${hadoop.log.dir}/rm-appsummary.log
log4j.appender.RMSUMMARY.layout=org.apache.log4j.PatternLayout
log4j.appender.RMSUMMARY.layout.ConversionPattern=%d{ISO8601} %p %c{2}: %m%n
log4j.appender.JSA.DatePattern=.yyyy-MM-dd
> MR279: finished applications should be added to an application summary log
> --------------------------------------------------------------------------
>
> Key: MAPREDUCE-2735
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2735
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Reporter: Thomas Graves
> Assignee: Thomas Graves
> Attachments: MAPREDUCE-2735.patch
>
>
> When an application finishes it should be added to an application summary log for historical purposes. jira MAPREDUCE-2649 is going to start purging applications from RM when certain limits are hit which makes this more critical. We also need to save the information early enough after the app finishes so we don't lose the info if the RM does get restarted.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-2735) MR279: finished applications
should be added to an application summary log
Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13094671#comment-13094671 ]
Hadoop QA commented on MAPREDUCE-2735:
--------------------------------------
-1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12492471/MAPREDUCE-2735.patch
against trunk revision .
+1 @author. The patch does not contain any @author tags.
+1 tests included. The patch appears to include 6 new or modified tests.
+1 javadoc. The javadoc tool did not generate any warning messages.
+1 javac. The applied patch does not increase the total number of javac compiler warnings.
-1 findbugs. The patch appears to introduce 6 new Findbugs (version 1.3.9) warnings.
+1 release audit. The applied patch does not increase the total number of release audit warnings.
+1 core tests. The patch passed unit tests in hadoop-mapreduce-project.
+1 contrib tests. The patch passed contrib unit tests.
Test results: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/571//testReport/
Findbugs warnings: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/571//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-yarn-common.html
Findbugs warnings: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/571//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-yarn-api.html
Findbugs warnings: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/571//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-yarn-server-common.html
Findbugs warnings: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/571//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-yarn-server-resourcemanager.html
Findbugs warnings: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/571//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-yarn-server-nodemanager.html
Findbugs warnings: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/571//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-mapreduce-client-app.html
Findbugs warnings: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/571//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-mapreduce-client-core.html
Findbugs warnings: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/571//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-mapreduce-client-common.html
Findbugs warnings: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/571//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-mapreduce-client-hs.html
Findbugs warnings: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/571//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-mapreduce-client-shuffle.html
Findbugs warnings: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/571//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-mapreduce-client-jobclient.html
Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/571//console
This message is automatically generated.
> MR279: finished applications should be added to an application summary log
> --------------------------------------------------------------------------
>
> Key: MAPREDUCE-2735
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2735
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Reporter: Thomas Graves
> Assignee: Thomas Graves
> Fix For: 0.23.0, 0.24.0
>
> Attachments: MAPREDUCE-2735.patch
>
>
> When an application finishes it should be added to an application summary log for historical purposes. jira MAPREDUCE-2649 is going to start purging applications from RM when certain limits are hit which makes this more critical. We also need to save the information early enough after the app finishes so we don't lose the info if the RM does get restarted.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-2735) MR279: finished applications
should be added to an application summary log
Posted by "Thomas Graves (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Thomas Graves updated MAPREDUCE-2735:
-------------------------------------
Attachment: MAPREDUCE-2735.patch
> MR279: finished applications should be added to an application summary log
> --------------------------------------------------------------------------
>
> Key: MAPREDUCE-2735
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2735
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Reporter: Thomas Graves
> Assignee: Thomas Graves
> Attachments: MAPREDUCE-2735.patch
>
>
> When an application finishes it should be added to an application summary log for historical purposes. jira MAPREDUCE-2649 is going to start purging applications from RM when certain limits are hit which makes this more critical. We also need to save the information early enough after the app finishes so we don't lose the info if the RM does get restarted.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-2735) MR279: finished applications
should be added to an application summary log
Posted by "Thomas Graves (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Thomas Graves updated MAPREDUCE-2735:
-------------------------------------
Status: Patch Available (was: Open)
> MR279: finished applications should be added to an application summary log
> --------------------------------------------------------------------------
>
> Key: MAPREDUCE-2735
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2735
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Reporter: Thomas Graves
> Assignee: Thomas Graves
> Attachments: MAPREDUCE-2735.patch
>
>
> When an application finishes it should be added to an application summary log for historical purposes. jira MAPREDUCE-2649 is going to start purging applications from RM when certain limits are hit which makes this more critical. We also need to save the information early enough after the app finishes so we don't lose the info if the RM does get restarted.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-2735) MR279: finished applications
should be added to an application summary log
Posted by "Arun C Murthy (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13095598#comment-13095598 ]
Arun C Murthy commented on MAPREDUCE-2735:
------------------------------------------
Yes, thanks.
> MR279: finished applications should be added to an application summary log
> --------------------------------------------------------------------------
>
> Key: MAPREDUCE-2735
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2735
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Reporter: Thomas Graves
> Assignee: Thomas Graves
> Fix For: 0.23.0, 0.24.0
>
> Attachments: MAPREDUCE-2735.patch
>
>
> When an application finishes it should be added to an application summary log for historical purposes. jira MAPREDUCE-2649 is going to start purging applications from RM when certain limits are hit which makes this more critical. We also need to save the information early enough after the app finishes so we don't lose the info if the RM does get restarted.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-2735) MR279: finished applications
should be added to an application summary log
Posted by "Thomas Graves (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13095577#comment-13095577 ]
Thomas Graves commented on MAPREDUCE-2735:
------------------------------------------
yes this is in addition to any job summary log. This is on the RM when an application completes, it gets recorded here.
> MR279: finished applications should be added to an application summary log
> --------------------------------------------------------------------------
>
> Key: MAPREDUCE-2735
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2735
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Reporter: Thomas Graves
> Assignee: Thomas Graves
> Fix For: 0.23.0, 0.24.0
>
> Attachments: MAPREDUCE-2735.patch
>
>
> When an application finishes it should be added to an application summary log for historical purposes. jira MAPREDUCE-2649 is going to start purging applications from RM when certain limits are hit which makes this more critical. We also need to save the information early enough after the app finishes so we don't lose the info if the RM does get restarted.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-2735) MR279: finished applications
should be added to an application summary log
Posted by "Arun C Murthy (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13095526#comment-13095526 ]
Arun C Murthy commented on MAPREDUCE-2735:
------------------------------------------
Thomas, just to clarify - this is in addition (i.e. on RM) to the MR JobSummary log? JobSummary log should be done by the JobHistory server...
> MR279: finished applications should be added to an application summary log
> --------------------------------------------------------------------------
>
> Key: MAPREDUCE-2735
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2735
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Reporter: Thomas Graves
> Assignee: Thomas Graves
> Fix For: 0.23.0, 0.24.0
>
> Attachments: MAPREDUCE-2735.patch
>
>
> When an application finishes it should be added to an application summary log for historical purposes. jira MAPREDUCE-2649 is going to start purging applications from RM when certain limits are hit which makes this more critical. We also need to save the information early enough after the app finishes so we don't lose the info if the RM does get restarted.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-2735) MR279: finished applications
should be added to an application summary log
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13095814#comment-13095814 ]
Hudson commented on MAPREDUCE-2735:
-----------------------------------
Integrated in Hadoop-Mapreduce-trunk-Commit #833 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/833/])
MAPREDUCE-2735. Add an applications summary log to ResourceManager. Contributed by Thomas Graves.
acmurthy : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1164301
Files :
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/conf/log4j.properties
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/RMAppManager.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/rmapp/MockRMApp.java
> MR279: finished applications should be added to an application summary log
> --------------------------------------------------------------------------
>
> Key: MAPREDUCE-2735
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2735
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Reporter: Thomas Graves
> Assignee: Thomas Graves
> Fix For: 0.23.0
>
> Attachments: MAPREDUCE-2735-v2.patch, MAPREDUCE-2735.patch
>
>
> When an application finishes it should be added to an application summary log for historical purposes. jira MAPREDUCE-2649 is going to start purging applications from RM when certain limits are hit which makes this more critical. We also need to save the information early enough after the app finishes so we don't lose the info if the RM does get restarted.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-2735) MR279: finished applications
should be added to an application summary log
Posted by "Thomas Graves (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13094700#comment-13094700 ]
Thomas Graves commented on MAPREDUCE-2735:
------------------------------------------
the findbugs errors were pre-existing MAPREDUCE-2908.
test-patch output when I run:
+1 overall.
+1 @author. The patch does not contain any @author tags.
+1 tests included. The patch appears to include 6 new or modified tests.
+1 javadoc. The javadoc tool did not generate any warning messages.
+1 javac. The applied patch does not increase the total number of javac compiler warnings.
+1 findbugs. The patch does not introduce any new Findbugs (version ) warnings.
+1 release audit. The applied patch does not increase the total number of release audit warnings.
> MR279: finished applications should be added to an application summary log
> --------------------------------------------------------------------------
>
> Key: MAPREDUCE-2735
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2735
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Reporter: Thomas Graves
> Assignee: Thomas Graves
> Fix For: 0.23.0, 0.24.0
>
> Attachments: MAPREDUCE-2735.patch
>
>
> When an application finishes it should be added to an application summary log for historical purposes. jira MAPREDUCE-2649 is going to start purging applications from RM when certain limits are hit which makes this more critical. We also need to save the information early enough after the app finishes so we don't lose the info if the RM does get restarted.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-2735) MR279: finished applications
should be added to an application summary log
Posted by "Arun C Murthy (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13095589#comment-13095589 ]
Arun C Murthy commented on MAPREDUCE-2735:
------------------------------------------
Thomas, the patch looks good. Can you please add a descriptive example to log4j.properties so that people know how to configure this on? Thanks.
> MR279: finished applications should be added to an application summary log
> --------------------------------------------------------------------------
>
> Key: MAPREDUCE-2735
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2735
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Reporter: Thomas Graves
> Assignee: Thomas Graves
> Fix For: 0.23.0, 0.24.0
>
> Attachments: MAPREDUCE-2735.patch
>
>
> When an application finishes it should be added to an application summary log for historical purposes. jira MAPREDUCE-2649 is going to start purging applications from RM when certain limits are hit which makes this more critical. We also need to save the information early enough after the app finishes so we don't lose the info if the RM does get restarted.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-2735) MR279: finished applications
should be added to an application summary log
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13095946#comment-13095946 ]
Hudson commented on MAPREDUCE-2735:
-----------------------------------
Integrated in Hadoop-Hdfs-trunk #780 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk/780/])
MAPREDUCE-2735. Add an applications summary log to ResourceManager. Contributed by Thomas Graves.
acmurthy : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1164301
Files :
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/conf/log4j.properties
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/RMAppManager.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/rmapp/MockRMApp.java
> MR279: finished applications should be added to an application summary log
> --------------------------------------------------------------------------
>
> Key: MAPREDUCE-2735
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2735
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Reporter: Thomas Graves
> Assignee: Thomas Graves
> Fix For: 0.23.0
>
> Attachments: MAPREDUCE-2735-v2.patch, MAPREDUCE-2735.patch
>
>
> When an application finishes it should be added to an application summary log for historical purposes. jira MAPREDUCE-2649 is going to start purging applications from RM when certain limits are hit which makes this more critical. We also need to save the information early enough after the app finishes so we don't lose the info if the RM does get restarted.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-2735) MR279: finished applications
should be added to an application summary log
Posted by "Thomas Graves (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Thomas Graves updated MAPREDUCE-2735:
-------------------------------------
Fix Version/s: 0.24.0
0.23.0
> MR279: finished applications should be added to an application summary log
> --------------------------------------------------------------------------
>
> Key: MAPREDUCE-2735
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2735
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Reporter: Thomas Graves
> Assignee: Thomas Graves
> Fix For: 0.23.0, 0.24.0
>
> Attachments: MAPREDUCE-2735.patch
>
>
> When an application finishes it should be added to an application summary log for historical purposes. jira MAPREDUCE-2649 is going to start purging applications from RM when certain limits are hit which makes this more critical. We also need to save the information early enough after the app finishes so we don't lose the info if the RM does get restarted.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira