You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-user@hadoop.apache.org by Christoph <li...@gmx.net> on 2009/11/18 17:14:34 UTC

java.io.FileNotFoundException: File file:/tmp/.../job.xml does not exist

Hi all,

I'm hitting the same issue as first described in:
http://mail-archives.apache.org/mod_mbox/hadoop-core-user/200905.mbox/%3Cbd0e4dee0905181624o42c48404l9bcf8678e62a0b71@mail.gmail.com%3E

But there is no answer yet ...
I'm using Hadoop 0.2 and recieve the following when I try to run a 
map/red job:

=====================
$ ./hadoop/bin/hadoop jar hadoop/hadoop-*-examples.jar grep 
hdfs://tenemhead/input output 'dcds'

09/11/18 17:09:45 INFO mapred.FileInputFormat: Total input paths to 
process : 1
09/11/18 17:09:45 INFO mapred.JobClient: Running job: job_200911181653_0002
09/11/18 17:09:46 INFO mapred.JobClient:  map 0% reduce 0%
09/11/18 17:09:52 INFO mapred.JobClient: Task Id : 
attempt_200911181653_0002_m_000003_0, Status : FAILED
Error initializing attempt_200911181653_0002_m_000003_0:
java.io.FileNotFoundException: File 
file:/tmp/hadoop-hadoop00/mapred/system/job_200911181653_0002/job.xml 
does not exist.
         at 
org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:361)
         at 
org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:245)
         at org.apache.hadoop.fs.FileUtil.copy(FileUtil.java:192)
         at org.apache.hadoop.fs.FileUtil.copy(FileUtil.java:142)
         at 
org.apache.hadoop.fs.LocalFileSystem.copyToLocalFile(LocalFileSystem.java:61)
         at 
org.apache.hadoop.fs.FileSystem.copyToLocalFile(FileSystem.java:1192)
         at 
org.apache.hadoop.mapred.TaskTracker.localizeJob(TaskTracker.java:771)
         at 
org.apache.hadoop.mapred.TaskTracker.startNewTask(TaskTracker.java:1664)
         at 
org.apache.hadoop.mapred.TaskTracker.access$1200(TaskTracker.java:97)
         at 
org.apache.hadoop.mapred.TaskTracker$TaskLauncher.run(TaskTracker.java:1629)

09/11/18 17:09:52 WARN mapred.JobClient: Error reading task 
outputhttp://tenem01.some_server.org:50060/tasklog?plaintext=true&taskid=attempt_200911181653_0002_m_000003_0&filter=stdout
09/11/18 17:09:52 WARN mapred.JobClient: Error reading task 
outputhttp://tenem01.some_server.org:50060/tasklog?plaintext=true&taskid=attempt_200911181653_0002_m_000003_0&filter=stderr
09/11/18 17:09:55 INFO mapred.JobClient: Task Id : 
attempt_200911181653_0002_r_000002_0, Status : FAILED
Error initializing attempt_200911181653_0002_r_000002_0:
java.io.FileNotFoundException: File 
file:/tmp/hadoop-hadoop00/mapred/system/job_200911181653_0002/job.xml 
does not exist.
         at 
org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:361)
         at 
org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:245)
         at org.apache.hadoop.fs.FileUtil.copy(FileUtil.java:192)
         at org.apache.hadoop.fs.FileUtil.copy(FileUtil.java:142)
         at 
org.apache.hadoop.fs.LocalFileSystem.copyToLocalFile(LocalFileSystem.java:61)
         at 
org.apache.hadoop.fs.FileSystem.copyToLocalFile(FileSystem.java:1192)
         at 
org.apache.hadoop.mapred.TaskTracker.localizeJob(TaskTracker.java:771)
         at 
org.apache.hadoop.mapred.TaskTracker.startNewTask(TaskTracker.java:1664)
         at 
org.apache.hadoop.mapred.TaskTracker.access$1200(TaskTracker.java:97)
         at 
org.apache.hadoop.mapred.TaskTracker$TaskLauncher.run(TaskTracker.java:1629)

=====================
=====================
=====================
Tnx for you help.
Chris

Re: java.io.FileNotFoundException: File file:/tmp/.../job.xml does not exist

Posted by Ahmad Ali Iqbal <ah...@gmail.com>.
Dear Christoph

My understanding is this error is due to the directory access. I would
suggest for simplicity that setup your namenode and datanode from hadoop
main directory and then run this example.

--
Ahmad Ali Iqbal
http://member.acm.org/~ahmad.iqbal

On Thu, Nov 19, 2009 at 3:14 AM, Christoph <li...@gmx.net> wrote:

>
> Hi all,
>
> I'm hitting the same issue as first described in:
>
> http://mail-archives.apache.org/mod_mbox/hadoop-core-user/200905.mbox/%3Cbd0e4dee0905181624o42c48404l9bcf8678e62a0b71@mail.gmail.com%3E
>
> But there is no answer yet ...
> I'm using Hadoop 0.2 and recieve the following when I try to run a map/red
> job:
>
> =====================
> $ ./hadoop/bin/hadoop jar hadoop/hadoop-*-examples.jar grep
> hdfs://tenemhead/input output 'dcds'
>
> 09/11/18 17:09:45 INFO mapred.FileInputFormat: Total input paths to process
> : 1
> 09/11/18 17:09:45 INFO mapred.JobClient: Running job: job_200911181653_0002
> 09/11/18 17:09:46 INFO mapred.JobClient:  map 0% reduce 0%
> 09/11/18 17:09:52 INFO mapred.JobClient: Task Id :
> attempt_200911181653_0002_m_000003_0, Status : FAILED
> Error initializing attempt_200911181653_0002_m_000003_0:
> java.io.FileNotFoundException: File
> file:/tmp/hadoop-hadoop00/mapred/system/job_200911181653_0002/job.xml does
> not exist.
>        at
> org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:361)
>        at
> org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:245)
>        at org.apache.hadoop.fs.FileUtil.copy(FileUtil.java:192)
>        at org.apache.hadoop.fs.FileUtil.copy(FileUtil.java:142)
>        at
> org.apache.hadoop.fs.LocalFileSystem.copyToLocalFile(LocalFileSystem.java:61)
>        at
> org.apache.hadoop.fs.FileSystem.copyToLocalFile(FileSystem.java:1192)
>        at
> org.apache.hadoop.mapred.TaskTracker.localizeJob(TaskTracker.java:771)
>        at
> org.apache.hadoop.mapred.TaskTracker.startNewTask(TaskTracker.java:1664)
>        at
> org.apache.hadoop.mapred.TaskTracker.access$1200(TaskTracker.java:97)
>        at
> org.apache.hadoop.mapred.TaskTracker$TaskLauncher.run(TaskTracker.java:1629)
>
> 09/11/18 17:09:52 WARN mapred.JobClient: Error reading task outputhttp://
> tenem01.some_server.org:50060/tasklog?plaintext=true&taskid=attempt_200911181653_0002_m_000003_0&filter=stdout
> 09/11/18 17:09:52 WARN mapred.JobClient: Error reading task outputhttp://
> tenem01.some_server.org:50060/tasklog?plaintext=true&taskid=attempt_200911181653_0002_m_000003_0&filter=stderr
> 09/11/18 17:09:55 INFO mapred.JobClient: Task Id :
> attempt_200911181653_0002_r_000002_0, Status : FAILED
> Error initializing attempt_200911181653_0002_r_000002_0:
> java.io.FileNotFoundException: File
> file:/tmp/hadoop-hadoop00/mapred/system/job_200911181653_0002/job.xml does
> not exist.
>        at
> org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:361)
>        at
> org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:245)
>        at org.apache.hadoop.fs.FileUtil.copy(FileUtil.java:192)
>        at org.apache.hadoop.fs.FileUtil.copy(FileUtil.java:142)
>        at
> org.apache.hadoop.fs.LocalFileSystem.copyToLocalFile(LocalFileSystem.java:61)
>        at
> org.apache.hadoop.fs.FileSystem.copyToLocalFile(FileSystem.java:1192)
>        at
> org.apache.hadoop.mapred.TaskTracker.localizeJob(TaskTracker.java:771)
>        at
> org.apache.hadoop.mapred.TaskTracker.startNewTask(TaskTracker.java:1664)
>        at
> org.apache.hadoop.mapred.TaskTracker.access$1200(TaskTracker.java:97)
>        at
> org.apache.hadoop.mapred.TaskTracker$TaskLauncher.run(TaskTracker.java:1629)
>
> =====================
> =====================
> =====================
> Tnx for you help.
> Chris
>
>
>

Re: java.io.FileNotFoundException: File file:/tmp/.../job.xml does not exist

Posted by Christoph <li...@gmx.net>.
Finally we found the issue:
The job.xml was there when it was needed, i.e., at job execution time.
The problem was some configuration mistake:
The property "fs.default.name" was by accident in the hdfs-site.xml - 
not in the core-site.xml. This cause that weird error message.

Cheers.
Christoph

Christoph wrote:
> 
> Hi all,
> 
> I'm hitting the same issue as first described in:
> http://mail-archives.apache.org/mod_mbox/hadoop-core-user/200905.mbox/%3Cbd0e4dee0905181624o42c48404l9bcf8678e62a0b71@mail.gmail.com%3E 
> 
> 
> But there is no answer yet ...
> I'm using Hadoop 0.2 and recieve the following when I try to run a 
> map/red job:
> 
> =====================
> $ ./hadoop/bin/hadoop jar hadoop/hadoop-*-examples.jar grep 
> hdfs://tenemhead/input output 'dcds'
> 
> 09/11/18 17:09:45 INFO mapred.FileInputFormat: Total input paths to 
> process : 1
> 09/11/18 17:09:45 INFO mapred.JobClient: Running job: job_200911181653_0002
> 09/11/18 17:09:46 INFO mapred.JobClient:  map 0% reduce 0%
> 09/11/18 17:09:52 INFO mapred.JobClient: Task Id : 
> attempt_200911181653_0002_m_000003_0, Status : FAILED
> Error initializing attempt_200911181653_0002_m_000003_0:
> java.io.FileNotFoundException: File 
> file:/tmp/hadoop-hadoop00/mapred/system/job_200911181653_0002/job.xml 
> does not exist.
>         at 
> org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:361) 
> 
>         at 
> org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:245) 
> 
>         at org.apache.hadoop.fs.FileUtil.copy(FileUtil.java:192)
>         at org.apache.hadoop.fs.FileUtil.copy(FileUtil.java:142)
>         at 
> org.apache.hadoop.fs.LocalFileSystem.copyToLocalFile(LocalFileSystem.java:61) 
> 
>         at 
> org.apache.hadoop.fs.FileSystem.copyToLocalFile(FileSystem.java:1192)
>         at 
> org.apache.hadoop.mapred.TaskTracker.localizeJob(TaskTracker.java:771)
>         at 
> org.apache.hadoop.mapred.TaskTracker.startNewTask(TaskTracker.java:1664)
>         at 
> org.apache.hadoop.mapred.TaskTracker.access$1200(TaskTracker.java:97)
>         at 
> org.apache.hadoop.mapred.TaskTracker$TaskLauncher.run(TaskTracker.java:1629) 
> 
> 
> 09/11/18 17:09:52 WARN mapred.JobClient: Error reading task 
> outputhttp://tenem01.some_server.org:50060/tasklog?plaintext=true&taskid=attempt_200911181653_0002_m_000003_0&filter=stdout 
> 
> 09/11/18 17:09:52 WARN mapred.JobClient: Error reading task 
> outputhttp://tenem01.some_server.org:50060/tasklog?plaintext=true&taskid=attempt_200911181653_0002_m_000003_0&filter=stderr 
> 
> 09/11/18 17:09:55 INFO mapred.JobClient: Task Id : 
> attempt_200911181653_0002_r_000002_0, Status : FAILED
> Error initializing attempt_200911181653_0002_r_000002_0:
> java.io.FileNotFoundException: File 
> file:/tmp/hadoop-hadoop00/mapred/system/job_200911181653_0002/job.xml 
> does not exist.
>         at 
> org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:361) 
> 
>         at 
> org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:245) 
> 
>         at org.apache.hadoop.fs.FileUtil.copy(FileUtil.java:192)
>         at org.apache.hadoop.fs.FileUtil.copy(FileUtil.java:142)
>         at 
> org.apache.hadoop.fs.LocalFileSystem.copyToLocalFile(LocalFileSystem.java:61) 
> 
>         at 
> org.apache.hadoop.fs.FileSystem.copyToLocalFile(FileSystem.java:1192)
>         at 
> org.apache.hadoop.mapred.TaskTracker.localizeJob(TaskTracker.java:771)
>         at 
> org.apache.hadoop.mapred.TaskTracker.startNewTask(TaskTracker.java:1664)
>         at 
> org.apache.hadoop.mapred.TaskTracker.access$1200(TaskTracker.java:97)
>         at 
> org.apache.hadoop.mapred.TaskTracker$TaskLauncher.run(TaskTracker.java:1629) 
> 
> 
> =====================
> =====================
> =====================
> Tnx for you help.
> Chris
>