[jira] [Commented] (MAPREDUCE-2059) RecoveryManager attempts to add jobtracker.info

["Subroto Sanyal (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/MAPREDUCE-2059?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13078695#comment-13078695 ] 

Subroto Sanyal commented on MAPREDUCE-2059:
-------------------------------------------

Hi Dan,

I can see two approaches to fix the problem:
a) Change the directory where Job information is getting used. Restart Recover will always search in this folder for Job Recovery.
Problem: The System Job Directory is being referenced from many places (Jobtracker, Tasktracker, Client). This approach may lead to code changes in multiple files.

b) Explicit check for *jobtracker.info* file while recovering job. This change is small and simple.

Please provide your opinion.

> RecoveryManager attempts to add jobtracker.info
> -----------------------------------------------
>
>                 Key: MAPREDUCE-2059
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2059
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: jobtracker
>    Affects Versions: 0.21.0, 0.22.0
>         Environment: https://svn.apache.org/repos/asf/hadoop/mapreduce/trunk@994941
>            Reporter: Dan Adkins
>
> The jobtracker is treating the file 'jobtracker.info' in the system data directory as a job to be recovered, resulting in the following:
> 10/09/09 18:06:02 WARN mapred.JobTracker: Failed to add the job jobtracker.info
> java.lang.IllegalArgumentException: JobId string : jobtracker.info is not properly formed
>         at org.apache.hadoop.mapreduce.JobID.forName(JobID.java:158)
>         at org.apache.hadoop.mapred.JobID.forName(JobID.java:84)
>         at org.apache.hadoop.mapred.JobTracker$RecoveryManager.addJobForRecovery(JobTracker.java:1057)
>         at org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:1565)
>         at org.apache.hadoop.mapred.JobTracker.startTracker(JobTracker.java:275)
>         at org.apache.hadoop.mapred.JobTracker.startTracker(JobTracker.java:267)
>         at org.apache.hadoop.mapred.JobTracker.startTracker(JobTracker.java:262)
>         at org.apache.hadoop.mapred.JobTracker.main(JobTracker.java:4256)

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira