help needed regarding EagerTaskInitializationListener

[Manhee Jo <jo...@nttdocomo.com>]

Hi all,

We've encounterd an "ERROR ...EagerTaskInitializationListener: Job 
initialization failed" on  our hadoop 0.19.2 cluster.
Reading the job tracker log, it seems that the job tracker tries to get a 
history file name from local file system on job tracker.
Why does it try to get this old file?
The file ".jt_1283752186987_job_201009061449_0801_user_sss.crc" in the log 
below
had been generated more than 30 days ago and possibly been deleted by 
HistoryCleaner.

2010-10-11 07:10:06,517 ERROR 
org.apache.hadoop.mapred.EagerTaskInitializationListener: Job initialization 
failed:
java.io.FileNotFoundException: File 
file:/xxx/history/.jt_1283752186987_job_201009061449_0801_user_sss.crc does 
not exist.
 at 
org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:420)
 at 
org.apache.hadoop.fs.RawLocalFileSystem.listStatus(RawLocalFileSystem.java:297)
 at org.apache.hadoop.fs.FileSystem.listStatus(FileSystem.java:723)
 at org.apache.hadoop.fs.FileSystem.listStatus(FileSystem.java:748)
 at 
org.apache.hadoop.fs.ChecksumFileSystem.listStatus(ChecksumFileSystem.java:457)
 at org.apache.hadoop.fs.FileSystem.listStatus(FileSystem.java:723)
 at org.apache.hadoop.fs.FileSystem.listStatus(FileSystem.java:748)
 at 
org.apache.hadoop.mapred.JobHistory$JobInfo.getJobHistoryFileName(JobHistory.java:662)
 at 
org.apache.hadoop.mapred.JobHistory$JobInfo.logSubmitted(JobHistory.java:805)
 at org.apache.hadoop.mapred.JobInProgress.initTasks(JobInProgress.java:360)
 at 
org.apache.hadoop.mapred.EagerTaskInitializationListener$JobInitThread.run(EagerTaskInitializationListener.java:55)
 at java.lang.Thread.run(Thread.java:619)


Plus, is HistoryCleaner only way to delete old history files? I just want to 
know when an by what the file 
".jt_1283752186987_job_201009061449_0801_user_sss.crc" has been deleted.


Thanks,
Manhee