You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-issues@hadoop.apache.org by "Ajay Babu Kakani (JIRA)" <ji...@apache.org> on 2017/06/23 20:43:00 UTC
[jira] [Commented] (MAPREDUCE-5641) History for failed Application
Masters should be made available to the Job History Server
[ https://issues.apache.org/jira/browse/MAPREDUCE-5641?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16061476#comment-16061476 ]
Ajay Babu Kakani commented on MAPREDUCE-5641:
---------------------------------------------
Oozie workflows are failed with Unable to find job job_XXXXXXXXX_XXXX because the job logs of application which failed at AM launch stage are not getting moved to JHS web UI.
The job failure may be likely seen from the Nodemanager that was running, which means it need the Nodemanager log for the NM that ran the below job https://JHS_node/jobhistory/job/job_XXXXXXXXX_XXXX. It is evident that AM failed to launch the job.
Can I know in which version it fix/going to fix?
> History for failed Application Masters should be made available to the Job History Server
> -----------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-5641
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-5641
> Project: Hadoop Map/Reduce
> Issue Type: Improvement
> Components: applicationmaster, jobhistoryserver
> Affects Versions: 2.2.0
> Reporter: Robert Kanter
> Attachments: MAPREDUCE-5641.patch, MAPREDUCE-5641.patch
>
>
> Currently, the JHS has no information about jobs whose AMs have failed. This is because the History is written by the AM to the intermediate folder just before finishing, so when it fails for any reason, this information isn't copied there. However, it is not lost as its in the AM's staging directory. To make the History available in the JHS, all we need to do is have another mechanism to move the History from the staging directory to the intermediate directory. The AM also writes a "Summary" file before exiting normally, which is also unavailable when the AM fails.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
---------------------------------------------------------------------
To unsubscribe, e-mail: mapreduce-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: mapreduce-issues-help@hadoop.apache.org