[jira] Updated: (HADOOP-2165) Augment JobHistory to store tasks' userlogs

["Vinod K V (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/HADOOP-2165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Vinod K V updated HADOOP-2165:
------------------------------

    Attachment: HADOOP-2165-20080910.1.txt

Attaching a new patch. In summary, it does the following:
 - Adds a INFO_URL key-val pair to the JobHistory TaskAttempt records. This stores the info-url of the TT corresponding to the TaskAttempt.
 - Changed JobHistory so that it logs this INFO_URL.
 - taskdetailshistory.jsp picks up this INFO_URL and displays the links to task-logs only after it makes sure that task-logs are not expired/removed from the correspond the TT. If we encounter connection/readout timeouts or other exceptions while determining whether task-logs are available or not, we still display the links assuming they might work later.
 - HistoryViewer just picks up the INFO_URL and adds the taskLogs links column. It doesn't check the availability of task-logs as history-viewer is primarily for offline usage and Mapred may/may not be up at that time.

> Augment JobHistory to store tasks' userlogs
> -------------------------------------------
>
>                 Key: HADOOP-2165
>                 URL: https://issues.apache.org/jira/browse/HADOOP-2165
>             Project: Hadoop Core
>          Issue Type: Improvement
>          Components: mapred
>            Reporter: Arun C Murthy
>            Assignee: Vinod K V
>         Attachments: HADOOP-2165-20080910.1.txt, patch_userlog_1.4.3.txt
>
>
> It will be very useful to be able to see the job's userlogs (the stdout/stderr/syslog of the tasks) from the JobHistory page. It will greatly aid in debugging etc.
> At the very minimum we should have links from the JobHistory to the logs on the TT.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.