You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-dev@hadoop.apache.org by "Sanjay Dahiya (JIRA)" <ji...@apache.org> on 2006/09/19 20:17:23 UTC
[jira] Updated: (HADOOP-239) job tracker WI drops jobs after 24
hours
[ http://issues.apache.org/jira/browse/HADOOP-239?page=all ]
Sanjay Dahiya updated HADOOP-239:
---------------------------------
Attachment: Hadoop-239.patch
A patch for maintaining job tracker history. This patch -
1. instruments JobInProgress to add log events to history file.
2. Jobhistory management with a job master index file and one history file per job, parser for job history files.
3. Contains WI for viewing Jobtracker history.
This patch depends on Hadoop-263, it wont work otherwise.
> job tracker WI drops jobs after 24 hours
> ----------------------------------------
>
> Key: HADOOP-239
> URL: http://issues.apache.org/jira/browse/HADOOP-239
> Project: Hadoop
> Issue Type: Bug
> Components: mapred
> Reporter: Yoram Arnon
> Assigned To: Sanjay Dahiya
> Priority: Minor
> Attachments: Hadoop-239.patch
>
>
> The jobtracker's WI, keeps track of jobs executed in the past 24 hours.
> if the cluster was idle for a day (say Sunday) it drops all its history.
> Monday morning, the page is empty.
> Better would be to store a fixed number of jobs (say 10 each of succeeded and failed jobs).
> Also, if the job tracker is restarted, it loses all its history.
> The history should be persistent, withstanding restarts and upgrades.
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira