You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-issues@hadoop.apache.org by "Mahadev konar (JIRA)" <ji...@apache.org> on 2011/03/24 00:29:05 UTC
[jira] [Created] (MAPREDUCE-2403) MR-279: Improve job history event
handling in AM to log to HDFS
MR-279: Improve job history event handling in AM to log to HDFS
---------------------------------------------------------------
Key: MAPREDUCE-2403
URL: https://issues.apache.org/jira/browse/MAPREDUCE-2403
Project: Hadoop Map/Reduce
Issue Type: Improvement
Components: mrv2
Reporter: Mahadev konar
Assignee: Krishna Ramachandran
Fix For: 0.23.0
Improve the job history event handling in the application master to log to HDFS in the staging directory for the job and also move it to the required location for the job history server to use.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-2403) MR-279: Improve job history event
handling in AM to log to HDFS
Posted by "Krishna Ramachandran (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Krishna Ramachandran updated MAPREDUCE-2403:
--------------------------------------------
Status: Patch Available (was: Open)
Attached file addresses this issue
Additional improvements will be added incrementally(indexed directory for done location)
> MR-279: Improve job history event handling in AM to log to HDFS
> ---------------------------------------------------------------
>
> Key: MAPREDUCE-2403
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2403
> Project: Hadoop Map/Reduce
> Issue Type: Improvement
> Components: mrv2
> Reporter: Mahadev konar
> Assignee: Krishna Ramachandran
> Fix For: 0.23.0
>
> Attachments: mapreduce-2403.patch
>
>
> Improve the job history event handling in the application master to log to HDFS in the staging directory for the job and also move it to the required location for the job history server to use.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-2403) MR-279: Improve job history event
handling in AM to log to HDFS
Posted by "Mahadev konar (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Mahadev konar updated MAPREDUCE-2403:
-------------------------------------
Resolution: Fixed
Status: Resolved (was: Patch Available)
I just pushed this to MR-279. I tried running this on a single node cluster and am not seeing complted job history files in HDFS. Can you please take a look at it?
> MR-279: Improve job history event handling in AM to log to HDFS
> ---------------------------------------------------------------
>
> Key: MAPREDUCE-2403
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2403
> Project: Hadoop Map/Reduce
> Issue Type: Improvement
> Components: mrv2
> Affects Versions: 0.23.0
> Reporter: Mahadev konar
> Assignee: Krishna Ramachandran
> Fix For: 0.23.0
>
> Attachments: mapreduce-2403.patch
>
>
> Improve the job history event handling in the application master to log to HDFS in the staging directory for the job and also move it to the required location for the job history server to use.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-2403) MR-279: Improve job history event
handling in AM to log to HDFS
Posted by "Krishna Ramachandran (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Krishna Ramachandran updated MAPREDUCE-2403:
--------------------------------------------
Attachment: mapreduce-2403.patch
Revised patch addresses all issues that came up during previous reviews
All unit tests passed (except for the one that failed without this patch as well)
Single node cluster tests passed
> MR-279: Improve job history event handling in AM to log to HDFS
> ---------------------------------------------------------------
>
> Key: MAPREDUCE-2403
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2403
> Project: Hadoop Map/Reduce
> Issue Type: Improvement
> Components: mrv2
> Reporter: Mahadev konar
> Assignee: Krishna Ramachandran
> Fix For: 0.23.0
>
> Attachments: mapreduce-2403.patch
>
>
> Improve the job history event handling in the application master to log to HDFS in the staging directory for the job and also move it to the required location for the job history server to use.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-2403) MR-279: Improve job history event
handling in AM to log to HDFS
Posted by "Krishna Ramachandran (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Krishna Ramachandran updated MAPREDUCE-2403:
--------------------------------------------
Affects Version/s: 0.23.0
> MR-279: Improve job history event handling in AM to log to HDFS
> ---------------------------------------------------------------
>
> Key: MAPREDUCE-2403
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2403
> Project: Hadoop Map/Reduce
> Issue Type: Improvement
> Components: mrv2
> Affects Versions: 0.23.0
> Reporter: Mahadev konar
> Assignee: Krishna Ramachandran
> Fix For: 0.23.0
>
> Attachments: mapreduce-2403.patch
>
>
> Improve the job history event handling in the application master to log to HDFS in the staging directory for the job and also move it to the required location for the job history server to use.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-2403) MR-279: Improve job history
event handling in AM to log to HDFS
Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13010542#comment-13010542 ]
Hadoop QA commented on MAPREDUCE-2403:
--------------------------------------
-1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12474459/mapreduce-2403.patch
against trunk revision 1082703.
+1 @author. The patch does not contain any @author tags.
+1 tests included. The patch appears to include 15 new or modified tests.
-1 patch. The patch command could not apply the patch.
Console output: https://hudson.apache.org/hudson/job/PreCommit-MAPREDUCE-Build/146//console
This message is automatically generated.
> MR-279: Improve job history event handling in AM to log to HDFS
> ---------------------------------------------------------------
>
> Key: MAPREDUCE-2403
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2403
> Project: Hadoop Map/Reduce
> Issue Type: Improvement
> Components: mrv2
> Reporter: Mahadev konar
> Assignee: Krishna Ramachandran
> Fix For: 0.23.0
>
> Attachments: mapreduce-2403.patch
>
>
> Improve the job history event handling in the application master to log to HDFS in the staging directory for the job and also move it to the required location for the job history server to use.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira