You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-user@hadoop.apache.org by Natalia Connolly <na...@gmail.com> on 2014/04/22 17:21:57 UTC
Strange error in Hadoop 2.2.0: FileNotFoundException: file:/tmp/hadoop-hadoop/mapred/
Hello,
I am running Hadoop 2.2.0 in a single-node "cluster" mode. My
application dies with the following strange error:
Caused by: java.lang.RuntimeException: java.io.FileNotFoundException:
file:/tmp/hadoop-hadoop/mapred/local/1398179594286/part-00000 (No such file
or directory)
This looks like the kind of file that should have been created on the
fly (and then deleted). Does anyone know what this error is really a
symptom of? Perhaps some permissions issues?
Thank you,
Natalia
Re: Strange error in Hadoop 2.2.0: FileNotFoundException: file:/tmp/hadoop-hadoop/mapred/
Posted by Shumin Guo <gs...@gmail.com>.
Can you list the file using hadoop commands? for example, hadoop fs -ls
...?
On Tue, Apr 22, 2014 at 10:32 AM, Natalia Connolly <
natalia.v.connolly@gmail.com> wrote:
> Hi Jay,
>
> I am really not sure how to answer this question. Here is the full
> error:
>
> 14/04/22 11:31:02 INFO mapred.LocalJobRunner: Map task executor complete.
> 14/04/22 11:31:02 WARN mapred.LocalJobRunner: job_local607122693_0003
> java.lang.Exception: java.lang.RuntimeException: Error in configuring
> object
> at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:403)
> Caused by: java.lang.RuntimeException: Error in configuring object
> at
> org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:109)
> at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:75)
> at
> org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:133)
> at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:425)
> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341)
> at
> org.apache.hadoop.mapred.LocalJobRunner$Job$MapTaskRunnable.run(LocalJobRunner.java:235)
> at
> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
> at java.util.concurrent.FutureTask.run(FutureTask.java:262)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> at java.lang.Thread.run(Thread.java:724)
> Caused by: java.lang.reflect.InvocationTargetException
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:606)
> at
> org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:106)
> ... 10 more
> Caused by: java.lang.RuntimeException: Error in configuring object
> at
> org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:109)
> at
> org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:75)
> at
> org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:133)
> at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:38)
> ... 15 more
> Caused by: java.lang.reflect.InvocationTargetException
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:606)
> at
> org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:106)
> ... 18 more
> Caused by: java.lang.RuntimeException: java.io.FileNotFoundException:
> file:/tmp/hadoop-hadoop/mapred/local/1398180662047/part-00000 (No such file
> or directory)
> at
> edu.uci.ics.fuzzyjoin.tokenorder.TokenLoad.loadTokenRank(TokenLoad.java:60)
> at
> edu.uci.ics.fuzzyjoin.tokenorder.TokenLoad.loadTokenRank(TokenLoad.java:40)
> at
> edu.uci.ics.fuzzyjoin.hadoop.ridpairs.token.MapSelfJoin.configure(MapSelfJoin.java:98)
> ... 23 more
> Caused by: java.io.FileNotFoundException:
> file:/tmp/hadoop-hadoop/mapred/local/1398180662047/part-00000 (No such file
> or directory)
> at java.io.FileInputStream.open(Native Method)
> at java.io.FileInputStream.<init>(FileInputStream.java:146)
> at java.io.FileInputStream.<init>(FileInputStream.java:101)
> at
> edu.uci.ics.fuzzyjoin.tokenorder.TokenLoad.loadTokenRank(TokenLoad.java:45)
> ... 25 more
> 14/04/22 11:31:03 INFO mapreduce.Job: Job job_local607122693_0003 running
> in uber mode : false
> 14/04/22 11:31:03 INFO mapreduce.Job: map 0% reduce 0%
> 14/04/22 11:31:03 INFO mapreduce.Job: Job job_local607122693_0003 failed
> with state FAILED due to: NA
> 14/04/22 11:31:03 INFO mapreduce.Job: Counters: 0
> java.io.IOException: Job failed!
> at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:836)
> at
> edu.uci.ics.fuzzyjoin.hadoop.FuzzyJoinDriver.run(FuzzyJoinDriver.java:179)
> at
> edu.uci.ics.fuzzyjoin.hadoop.ridpairs.RIDPairsImproved.main(RIDPairsImproved.java:108)
> at edu.uci.ics.fuzzyjoin.hadoop.FuzzyJoin.bib(FuzzyJoin.java:39)
> at edu.uci.ics.fuzzyjoin.hadoop.FuzzyJoin.main(FuzzyJoin.java:86)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:606)
> at
> org.apache.hadoop.util.ProgramDriver$ProgramDescription.invoke(ProgramDriver.java:72)
> at org.apache.hadoop.util.ProgramDriver.run(ProgramDriver.java:144)
> at org.apache.hadoop.util.ProgramDriver.driver(ProgramDriver.java:152)
> at
> edu.uci.ics.fuzzyjoin.hadoop.FuzzyJoinDriver.main(FuzzyJoinDriver.java:121)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:606)
> at org.apache.hadoop.util.RunJar.main(RunJar.java:212)
>
>
>
> On Tue, Apr 22, 2014 at 11:25 AM, Jay Vyas <ja...@gmail.com> wrote:
>
>> Is this happening in the job client? or the mappers?
>>
>>
>> On Tue, Apr 22, 2014 at 11:21 AM, Natalia Connolly <
>> natalia.v.connolly@gmail.com> wrote:
>>
>>> Hello,
>>>
>>> I am running Hadoop 2.2.0 in a single-node "cluster" mode. My
>>> application dies with the following strange error:
>>>
>>> Caused by: java.lang.RuntimeException: java.io.FileNotFoundException:
>>> file:/tmp/hadoop-hadoop/mapred/local/1398179594286/part-00000 (No such file
>>> or directory)
>>>
>>> This looks like the kind of file that should have been created on the
>>> fly (and then deleted). Does anyone know what this error is really a
>>> symptom of? Perhaps some permissions issues?
>>>
>>> Thank you,
>>>
>>> Natalia
>>>
>>>
>>
>>
>> --
>> Jay Vyas
>> http://jayunit100.blogspot.com
>>
>
>
Re: Strange error in Hadoop 2.2.0: FileNotFoundException: file:/tmp/hadoop-hadoop/mapred/
Posted by Shumin Guo <gs...@gmail.com>.
Can you list the file using hadoop commands? for example, hadoop fs -ls
...?
On Tue, Apr 22, 2014 at 10:32 AM, Natalia Connolly <
natalia.v.connolly@gmail.com> wrote:
> Hi Jay,
>
> I am really not sure how to answer this question. Here is the full
> error:
>
> 14/04/22 11:31:02 INFO mapred.LocalJobRunner: Map task executor complete.
> 14/04/22 11:31:02 WARN mapred.LocalJobRunner: job_local607122693_0003
> java.lang.Exception: java.lang.RuntimeException: Error in configuring
> object
> at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:403)
> Caused by: java.lang.RuntimeException: Error in configuring object
> at
> org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:109)
> at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:75)
> at
> org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:133)
> at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:425)
> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341)
> at
> org.apache.hadoop.mapred.LocalJobRunner$Job$MapTaskRunnable.run(LocalJobRunner.java:235)
> at
> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
> at java.util.concurrent.FutureTask.run(FutureTask.java:262)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> at java.lang.Thread.run(Thread.java:724)
> Caused by: java.lang.reflect.InvocationTargetException
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:606)
> at
> org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:106)
> ... 10 more
> Caused by: java.lang.RuntimeException: Error in configuring object
> at
> org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:109)
> at
> org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:75)
> at
> org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:133)
> at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:38)
> ... 15 more
> Caused by: java.lang.reflect.InvocationTargetException
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:606)
> at
> org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:106)
> ... 18 more
> Caused by: java.lang.RuntimeException: java.io.FileNotFoundException:
> file:/tmp/hadoop-hadoop/mapred/local/1398180662047/part-00000 (No such file
> or directory)
> at
> edu.uci.ics.fuzzyjoin.tokenorder.TokenLoad.loadTokenRank(TokenLoad.java:60)
> at
> edu.uci.ics.fuzzyjoin.tokenorder.TokenLoad.loadTokenRank(TokenLoad.java:40)
> at
> edu.uci.ics.fuzzyjoin.hadoop.ridpairs.token.MapSelfJoin.configure(MapSelfJoin.java:98)
> ... 23 more
> Caused by: java.io.FileNotFoundException:
> file:/tmp/hadoop-hadoop/mapred/local/1398180662047/part-00000 (No such file
> or directory)
> at java.io.FileInputStream.open(Native Method)
> at java.io.FileInputStream.<init>(FileInputStream.java:146)
> at java.io.FileInputStream.<init>(FileInputStream.java:101)
> at
> edu.uci.ics.fuzzyjoin.tokenorder.TokenLoad.loadTokenRank(TokenLoad.java:45)
> ... 25 more
> 14/04/22 11:31:03 INFO mapreduce.Job: Job job_local607122693_0003 running
> in uber mode : false
> 14/04/22 11:31:03 INFO mapreduce.Job: map 0% reduce 0%
> 14/04/22 11:31:03 INFO mapreduce.Job: Job job_local607122693_0003 failed
> with state FAILED due to: NA
> 14/04/22 11:31:03 INFO mapreduce.Job: Counters: 0
> java.io.IOException: Job failed!
> at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:836)
> at
> edu.uci.ics.fuzzyjoin.hadoop.FuzzyJoinDriver.run(FuzzyJoinDriver.java:179)
> at
> edu.uci.ics.fuzzyjoin.hadoop.ridpairs.RIDPairsImproved.main(RIDPairsImproved.java:108)
> at edu.uci.ics.fuzzyjoin.hadoop.FuzzyJoin.bib(FuzzyJoin.java:39)
> at edu.uci.ics.fuzzyjoin.hadoop.FuzzyJoin.main(FuzzyJoin.java:86)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:606)
> at
> org.apache.hadoop.util.ProgramDriver$ProgramDescription.invoke(ProgramDriver.java:72)
> at org.apache.hadoop.util.ProgramDriver.run(ProgramDriver.java:144)
> at org.apache.hadoop.util.ProgramDriver.driver(ProgramDriver.java:152)
> at
> edu.uci.ics.fuzzyjoin.hadoop.FuzzyJoinDriver.main(FuzzyJoinDriver.java:121)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:606)
> at org.apache.hadoop.util.RunJar.main(RunJar.java:212)
>
>
>
> On Tue, Apr 22, 2014 at 11:25 AM, Jay Vyas <ja...@gmail.com> wrote:
>
>> Is this happening in the job client? or the mappers?
>>
>>
>> On Tue, Apr 22, 2014 at 11:21 AM, Natalia Connolly <
>> natalia.v.connolly@gmail.com> wrote:
>>
>>> Hello,
>>>
>>> I am running Hadoop 2.2.0 in a single-node "cluster" mode. My
>>> application dies with the following strange error:
>>>
>>> Caused by: java.lang.RuntimeException: java.io.FileNotFoundException:
>>> file:/tmp/hadoop-hadoop/mapred/local/1398179594286/part-00000 (No such file
>>> or directory)
>>>
>>> This looks like the kind of file that should have been created on the
>>> fly (and then deleted). Does anyone know what this error is really a
>>> symptom of? Perhaps some permissions issues?
>>>
>>> Thank you,
>>>
>>> Natalia
>>>
>>>
>>
>>
>> --
>> Jay Vyas
>> http://jayunit100.blogspot.com
>>
>
>
Re: Strange error in Hadoop 2.2.0: FileNotFoundException: file:/tmp/hadoop-hadoop/mapred/
Posted by Shumin Guo <gs...@gmail.com>.
Can you list the file using hadoop commands? for example, hadoop fs -ls
...?
On Tue, Apr 22, 2014 at 10:32 AM, Natalia Connolly <
natalia.v.connolly@gmail.com> wrote:
> Hi Jay,
>
> I am really not sure how to answer this question. Here is the full
> error:
>
> 14/04/22 11:31:02 INFO mapred.LocalJobRunner: Map task executor complete.
> 14/04/22 11:31:02 WARN mapred.LocalJobRunner: job_local607122693_0003
> java.lang.Exception: java.lang.RuntimeException: Error in configuring
> object
> at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:403)
> Caused by: java.lang.RuntimeException: Error in configuring object
> at
> org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:109)
> at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:75)
> at
> org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:133)
> at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:425)
> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341)
> at
> org.apache.hadoop.mapred.LocalJobRunner$Job$MapTaskRunnable.run(LocalJobRunner.java:235)
> at
> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
> at java.util.concurrent.FutureTask.run(FutureTask.java:262)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> at java.lang.Thread.run(Thread.java:724)
> Caused by: java.lang.reflect.InvocationTargetException
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:606)
> at
> org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:106)
> ... 10 more
> Caused by: java.lang.RuntimeException: Error in configuring object
> at
> org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:109)
> at
> org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:75)
> at
> org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:133)
> at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:38)
> ... 15 more
> Caused by: java.lang.reflect.InvocationTargetException
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:606)
> at
> org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:106)
> ... 18 more
> Caused by: java.lang.RuntimeException: java.io.FileNotFoundException:
> file:/tmp/hadoop-hadoop/mapred/local/1398180662047/part-00000 (No such file
> or directory)
> at
> edu.uci.ics.fuzzyjoin.tokenorder.TokenLoad.loadTokenRank(TokenLoad.java:60)
> at
> edu.uci.ics.fuzzyjoin.tokenorder.TokenLoad.loadTokenRank(TokenLoad.java:40)
> at
> edu.uci.ics.fuzzyjoin.hadoop.ridpairs.token.MapSelfJoin.configure(MapSelfJoin.java:98)
> ... 23 more
> Caused by: java.io.FileNotFoundException:
> file:/tmp/hadoop-hadoop/mapred/local/1398180662047/part-00000 (No such file
> or directory)
> at java.io.FileInputStream.open(Native Method)
> at java.io.FileInputStream.<init>(FileInputStream.java:146)
> at java.io.FileInputStream.<init>(FileInputStream.java:101)
> at
> edu.uci.ics.fuzzyjoin.tokenorder.TokenLoad.loadTokenRank(TokenLoad.java:45)
> ... 25 more
> 14/04/22 11:31:03 INFO mapreduce.Job: Job job_local607122693_0003 running
> in uber mode : false
> 14/04/22 11:31:03 INFO mapreduce.Job: map 0% reduce 0%
> 14/04/22 11:31:03 INFO mapreduce.Job: Job job_local607122693_0003 failed
> with state FAILED due to: NA
> 14/04/22 11:31:03 INFO mapreduce.Job: Counters: 0
> java.io.IOException: Job failed!
> at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:836)
> at
> edu.uci.ics.fuzzyjoin.hadoop.FuzzyJoinDriver.run(FuzzyJoinDriver.java:179)
> at
> edu.uci.ics.fuzzyjoin.hadoop.ridpairs.RIDPairsImproved.main(RIDPairsImproved.java:108)
> at edu.uci.ics.fuzzyjoin.hadoop.FuzzyJoin.bib(FuzzyJoin.java:39)
> at edu.uci.ics.fuzzyjoin.hadoop.FuzzyJoin.main(FuzzyJoin.java:86)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:606)
> at
> org.apache.hadoop.util.ProgramDriver$ProgramDescription.invoke(ProgramDriver.java:72)
> at org.apache.hadoop.util.ProgramDriver.run(ProgramDriver.java:144)
> at org.apache.hadoop.util.ProgramDriver.driver(ProgramDriver.java:152)
> at
> edu.uci.ics.fuzzyjoin.hadoop.FuzzyJoinDriver.main(FuzzyJoinDriver.java:121)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:606)
> at org.apache.hadoop.util.RunJar.main(RunJar.java:212)
>
>
>
> On Tue, Apr 22, 2014 at 11:25 AM, Jay Vyas <ja...@gmail.com> wrote:
>
>> Is this happening in the job client? or the mappers?
>>
>>
>> On Tue, Apr 22, 2014 at 11:21 AM, Natalia Connolly <
>> natalia.v.connolly@gmail.com> wrote:
>>
>>> Hello,
>>>
>>> I am running Hadoop 2.2.0 in a single-node "cluster" mode. My
>>> application dies with the following strange error:
>>>
>>> Caused by: java.lang.RuntimeException: java.io.FileNotFoundException:
>>> file:/tmp/hadoop-hadoop/mapred/local/1398179594286/part-00000 (No such file
>>> or directory)
>>>
>>> This looks like the kind of file that should have been created on the
>>> fly (and then deleted). Does anyone know what this error is really a
>>> symptom of? Perhaps some permissions issues?
>>>
>>> Thank you,
>>>
>>> Natalia
>>>
>>>
>>
>>
>> --
>> Jay Vyas
>> http://jayunit100.blogspot.com
>>
>
>
Re: Strange error in Hadoop 2.2.0: FileNotFoundException: file:/tmp/hadoop-hadoop/mapred/
Posted by Shumin Guo <gs...@gmail.com>.
Can you list the file using hadoop commands? for example, hadoop fs -ls
...?
On Tue, Apr 22, 2014 at 10:32 AM, Natalia Connolly <
natalia.v.connolly@gmail.com> wrote:
> Hi Jay,
>
> I am really not sure how to answer this question. Here is the full
> error:
>
> 14/04/22 11:31:02 INFO mapred.LocalJobRunner: Map task executor complete.
> 14/04/22 11:31:02 WARN mapred.LocalJobRunner: job_local607122693_0003
> java.lang.Exception: java.lang.RuntimeException: Error in configuring
> object
> at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:403)
> Caused by: java.lang.RuntimeException: Error in configuring object
> at
> org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:109)
> at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:75)
> at
> org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:133)
> at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:425)
> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341)
> at
> org.apache.hadoop.mapred.LocalJobRunner$Job$MapTaskRunnable.run(LocalJobRunner.java:235)
> at
> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
> at java.util.concurrent.FutureTask.run(FutureTask.java:262)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> at java.lang.Thread.run(Thread.java:724)
> Caused by: java.lang.reflect.InvocationTargetException
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:606)
> at
> org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:106)
> ... 10 more
> Caused by: java.lang.RuntimeException: Error in configuring object
> at
> org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:109)
> at
> org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:75)
> at
> org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:133)
> at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:38)
> ... 15 more
> Caused by: java.lang.reflect.InvocationTargetException
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:606)
> at
> org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:106)
> ... 18 more
> Caused by: java.lang.RuntimeException: java.io.FileNotFoundException:
> file:/tmp/hadoop-hadoop/mapred/local/1398180662047/part-00000 (No such file
> or directory)
> at
> edu.uci.ics.fuzzyjoin.tokenorder.TokenLoad.loadTokenRank(TokenLoad.java:60)
> at
> edu.uci.ics.fuzzyjoin.tokenorder.TokenLoad.loadTokenRank(TokenLoad.java:40)
> at
> edu.uci.ics.fuzzyjoin.hadoop.ridpairs.token.MapSelfJoin.configure(MapSelfJoin.java:98)
> ... 23 more
> Caused by: java.io.FileNotFoundException:
> file:/tmp/hadoop-hadoop/mapred/local/1398180662047/part-00000 (No such file
> or directory)
> at java.io.FileInputStream.open(Native Method)
> at java.io.FileInputStream.<init>(FileInputStream.java:146)
> at java.io.FileInputStream.<init>(FileInputStream.java:101)
> at
> edu.uci.ics.fuzzyjoin.tokenorder.TokenLoad.loadTokenRank(TokenLoad.java:45)
> ... 25 more
> 14/04/22 11:31:03 INFO mapreduce.Job: Job job_local607122693_0003 running
> in uber mode : false
> 14/04/22 11:31:03 INFO mapreduce.Job: map 0% reduce 0%
> 14/04/22 11:31:03 INFO mapreduce.Job: Job job_local607122693_0003 failed
> with state FAILED due to: NA
> 14/04/22 11:31:03 INFO mapreduce.Job: Counters: 0
> java.io.IOException: Job failed!
> at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:836)
> at
> edu.uci.ics.fuzzyjoin.hadoop.FuzzyJoinDriver.run(FuzzyJoinDriver.java:179)
> at
> edu.uci.ics.fuzzyjoin.hadoop.ridpairs.RIDPairsImproved.main(RIDPairsImproved.java:108)
> at edu.uci.ics.fuzzyjoin.hadoop.FuzzyJoin.bib(FuzzyJoin.java:39)
> at edu.uci.ics.fuzzyjoin.hadoop.FuzzyJoin.main(FuzzyJoin.java:86)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:606)
> at
> org.apache.hadoop.util.ProgramDriver$ProgramDescription.invoke(ProgramDriver.java:72)
> at org.apache.hadoop.util.ProgramDriver.run(ProgramDriver.java:144)
> at org.apache.hadoop.util.ProgramDriver.driver(ProgramDriver.java:152)
> at
> edu.uci.ics.fuzzyjoin.hadoop.FuzzyJoinDriver.main(FuzzyJoinDriver.java:121)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:606)
> at org.apache.hadoop.util.RunJar.main(RunJar.java:212)
>
>
>
> On Tue, Apr 22, 2014 at 11:25 AM, Jay Vyas <ja...@gmail.com> wrote:
>
>> Is this happening in the job client? or the mappers?
>>
>>
>> On Tue, Apr 22, 2014 at 11:21 AM, Natalia Connolly <
>> natalia.v.connolly@gmail.com> wrote:
>>
>>> Hello,
>>>
>>> I am running Hadoop 2.2.0 in a single-node "cluster" mode. My
>>> application dies with the following strange error:
>>>
>>> Caused by: java.lang.RuntimeException: java.io.FileNotFoundException:
>>> file:/tmp/hadoop-hadoop/mapred/local/1398179594286/part-00000 (No such file
>>> or directory)
>>>
>>> This looks like the kind of file that should have been created on the
>>> fly (and then deleted). Does anyone know what this error is really a
>>> symptom of? Perhaps some permissions issues?
>>>
>>> Thank you,
>>>
>>> Natalia
>>>
>>>
>>
>>
>> --
>> Jay Vyas
>> http://jayunit100.blogspot.com
>>
>
>
Re: Strange error in Hadoop 2.2.0: FileNotFoundException: file:/tmp/hadoop-hadoop/mapred/
Posted by Natalia Connolly <na...@gmail.com>.
Hi Jay,
I am really not sure how to answer this question. Here is the full
error:
14/04/22 11:31:02 INFO mapred.LocalJobRunner: Map task executor complete.
14/04/22 11:31:02 WARN mapred.LocalJobRunner: job_local607122693_0003
java.lang.Exception: java.lang.RuntimeException: Error in configuring object
at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:403)
Caused by: java.lang.RuntimeException: Error in configuring object
at
org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:109)
at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:75)
at
org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:133)
at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:425)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341)
at
org.apache.hadoop.mapred.LocalJobRunner$Job$MapTaskRunnable.run(LocalJobRunner.java:235)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:724)
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at
org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:106)
... 10 more
Caused by: java.lang.RuntimeException: Error in configuring object
at
org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:109)
at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:75)
at
org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:133)
at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:38)
... 15 more
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at
org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:106)
... 18 more
Caused by: java.lang.RuntimeException: java.io.FileNotFoundException:
file:/tmp/hadoop-hadoop/mapred/local/1398180662047/part-00000 (No such file
or directory)
at
edu.uci.ics.fuzzyjoin.tokenorder.TokenLoad.loadTokenRank(TokenLoad.java:60)
at
edu.uci.ics.fuzzyjoin.tokenorder.TokenLoad.loadTokenRank(TokenLoad.java:40)
at
edu.uci.ics.fuzzyjoin.hadoop.ridpairs.token.MapSelfJoin.configure(MapSelfJoin.java:98)
... 23 more
Caused by: java.io.FileNotFoundException:
file:/tmp/hadoop-hadoop/mapred/local/1398180662047/part-00000 (No such file
or directory)
at java.io.FileInputStream.open(Native Method)
at java.io.FileInputStream.<init>(FileInputStream.java:146)
at java.io.FileInputStream.<init>(FileInputStream.java:101)
at
edu.uci.ics.fuzzyjoin.tokenorder.TokenLoad.loadTokenRank(TokenLoad.java:45)
... 25 more
14/04/22 11:31:03 INFO mapreduce.Job: Job job_local607122693_0003 running
in uber mode : false
14/04/22 11:31:03 INFO mapreduce.Job: map 0% reduce 0%
14/04/22 11:31:03 INFO mapreduce.Job: Job job_local607122693_0003 failed
with state FAILED due to: NA
14/04/22 11:31:03 INFO mapreduce.Job: Counters: 0
java.io.IOException: Job failed!
at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:836)
at
edu.uci.ics.fuzzyjoin.hadoop.FuzzyJoinDriver.run(FuzzyJoinDriver.java:179)
at
edu.uci.ics.fuzzyjoin.hadoop.ridpairs.RIDPairsImproved.main(RIDPairsImproved.java:108)
at edu.uci.ics.fuzzyjoin.hadoop.FuzzyJoin.bib(FuzzyJoin.java:39)
at edu.uci.ics.fuzzyjoin.hadoop.FuzzyJoin.main(FuzzyJoin.java:86)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at
org.apache.hadoop.util.ProgramDriver$ProgramDescription.invoke(ProgramDriver.java:72)
at org.apache.hadoop.util.ProgramDriver.run(ProgramDriver.java:144)
at org.apache.hadoop.util.ProgramDriver.driver(ProgramDriver.java:152)
at
edu.uci.ics.fuzzyjoin.hadoop.FuzzyJoinDriver.main(FuzzyJoinDriver.java:121)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at org.apache.hadoop.util.RunJar.main(RunJar.java:212)
On Tue, Apr 22, 2014 at 11:25 AM, Jay Vyas <ja...@gmail.com> wrote:
> Is this happening in the job client? or the mappers?
>
>
> On Tue, Apr 22, 2014 at 11:21 AM, Natalia Connolly <
> natalia.v.connolly@gmail.com> wrote:
>
>> Hello,
>>
>> I am running Hadoop 2.2.0 in a single-node "cluster" mode. My
>> application dies with the following strange error:
>>
>> Caused by: java.lang.RuntimeException: java.io.FileNotFoundException:
>> file:/tmp/hadoop-hadoop/mapred/local/1398179594286/part-00000 (No such file
>> or directory)
>>
>> This looks like the kind of file that should have been created on the
>> fly (and then deleted). Does anyone know what this error is really a
>> symptom of? Perhaps some permissions issues?
>>
>> Thank you,
>>
>> Natalia
>>
>>
>
>
> --
> Jay Vyas
> http://jayunit100.blogspot.com
>
Re: Strange error in Hadoop 2.2.0: FileNotFoundException: file:/tmp/hadoop-hadoop/mapred/
Posted by Natalia Connolly <na...@gmail.com>.
Hi Jay,
I am really not sure how to answer this question. Here is the full
error:
14/04/22 11:31:02 INFO mapred.LocalJobRunner: Map task executor complete.
14/04/22 11:31:02 WARN mapred.LocalJobRunner: job_local607122693_0003
java.lang.Exception: java.lang.RuntimeException: Error in configuring object
at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:403)
Caused by: java.lang.RuntimeException: Error in configuring object
at
org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:109)
at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:75)
at
org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:133)
at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:425)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341)
at
org.apache.hadoop.mapred.LocalJobRunner$Job$MapTaskRunnable.run(LocalJobRunner.java:235)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:724)
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at
org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:106)
... 10 more
Caused by: java.lang.RuntimeException: Error in configuring object
at
org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:109)
at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:75)
at
org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:133)
at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:38)
... 15 more
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at
org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:106)
... 18 more
Caused by: java.lang.RuntimeException: java.io.FileNotFoundException:
file:/tmp/hadoop-hadoop/mapred/local/1398180662047/part-00000 (No such file
or directory)
at
edu.uci.ics.fuzzyjoin.tokenorder.TokenLoad.loadTokenRank(TokenLoad.java:60)
at
edu.uci.ics.fuzzyjoin.tokenorder.TokenLoad.loadTokenRank(TokenLoad.java:40)
at
edu.uci.ics.fuzzyjoin.hadoop.ridpairs.token.MapSelfJoin.configure(MapSelfJoin.java:98)
... 23 more
Caused by: java.io.FileNotFoundException:
file:/tmp/hadoop-hadoop/mapred/local/1398180662047/part-00000 (No such file
or directory)
at java.io.FileInputStream.open(Native Method)
at java.io.FileInputStream.<init>(FileInputStream.java:146)
at java.io.FileInputStream.<init>(FileInputStream.java:101)
at
edu.uci.ics.fuzzyjoin.tokenorder.TokenLoad.loadTokenRank(TokenLoad.java:45)
... 25 more
14/04/22 11:31:03 INFO mapreduce.Job: Job job_local607122693_0003 running
in uber mode : false
14/04/22 11:31:03 INFO mapreduce.Job: map 0% reduce 0%
14/04/22 11:31:03 INFO mapreduce.Job: Job job_local607122693_0003 failed
with state FAILED due to: NA
14/04/22 11:31:03 INFO mapreduce.Job: Counters: 0
java.io.IOException: Job failed!
at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:836)
at
edu.uci.ics.fuzzyjoin.hadoop.FuzzyJoinDriver.run(FuzzyJoinDriver.java:179)
at
edu.uci.ics.fuzzyjoin.hadoop.ridpairs.RIDPairsImproved.main(RIDPairsImproved.java:108)
at edu.uci.ics.fuzzyjoin.hadoop.FuzzyJoin.bib(FuzzyJoin.java:39)
at edu.uci.ics.fuzzyjoin.hadoop.FuzzyJoin.main(FuzzyJoin.java:86)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at
org.apache.hadoop.util.ProgramDriver$ProgramDescription.invoke(ProgramDriver.java:72)
at org.apache.hadoop.util.ProgramDriver.run(ProgramDriver.java:144)
at org.apache.hadoop.util.ProgramDriver.driver(ProgramDriver.java:152)
at
edu.uci.ics.fuzzyjoin.hadoop.FuzzyJoinDriver.main(FuzzyJoinDriver.java:121)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at org.apache.hadoop.util.RunJar.main(RunJar.java:212)
On Tue, Apr 22, 2014 at 11:25 AM, Jay Vyas <ja...@gmail.com> wrote:
> Is this happening in the job client? or the mappers?
>
>
> On Tue, Apr 22, 2014 at 11:21 AM, Natalia Connolly <
> natalia.v.connolly@gmail.com> wrote:
>
>> Hello,
>>
>> I am running Hadoop 2.2.0 in a single-node "cluster" mode. My
>> application dies with the following strange error:
>>
>> Caused by: java.lang.RuntimeException: java.io.FileNotFoundException:
>> file:/tmp/hadoop-hadoop/mapred/local/1398179594286/part-00000 (No such file
>> or directory)
>>
>> This looks like the kind of file that should have been created on the
>> fly (and then deleted). Does anyone know what this error is really a
>> symptom of? Perhaps some permissions issues?
>>
>> Thank you,
>>
>> Natalia
>>
>>
>
>
> --
> Jay Vyas
> http://jayunit100.blogspot.com
>
Re: Strange error in Hadoop 2.2.0: FileNotFoundException: file:/tmp/hadoop-hadoop/mapred/
Posted by Natalia Connolly <na...@gmail.com>.
Hi Jay,
I am really not sure how to answer this question. Here is the full
error:
14/04/22 11:31:02 INFO mapred.LocalJobRunner: Map task executor complete.
14/04/22 11:31:02 WARN mapred.LocalJobRunner: job_local607122693_0003
java.lang.Exception: java.lang.RuntimeException: Error in configuring object
at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:403)
Caused by: java.lang.RuntimeException: Error in configuring object
at
org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:109)
at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:75)
at
org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:133)
at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:425)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341)
at
org.apache.hadoop.mapred.LocalJobRunner$Job$MapTaskRunnable.run(LocalJobRunner.java:235)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:724)
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at
org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:106)
... 10 more
Caused by: java.lang.RuntimeException: Error in configuring object
at
org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:109)
at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:75)
at
org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:133)
at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:38)
... 15 more
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at
org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:106)
... 18 more
Caused by: java.lang.RuntimeException: java.io.FileNotFoundException:
file:/tmp/hadoop-hadoop/mapred/local/1398180662047/part-00000 (No such file
or directory)
at
edu.uci.ics.fuzzyjoin.tokenorder.TokenLoad.loadTokenRank(TokenLoad.java:60)
at
edu.uci.ics.fuzzyjoin.tokenorder.TokenLoad.loadTokenRank(TokenLoad.java:40)
at
edu.uci.ics.fuzzyjoin.hadoop.ridpairs.token.MapSelfJoin.configure(MapSelfJoin.java:98)
... 23 more
Caused by: java.io.FileNotFoundException:
file:/tmp/hadoop-hadoop/mapred/local/1398180662047/part-00000 (No such file
or directory)
at java.io.FileInputStream.open(Native Method)
at java.io.FileInputStream.<init>(FileInputStream.java:146)
at java.io.FileInputStream.<init>(FileInputStream.java:101)
at
edu.uci.ics.fuzzyjoin.tokenorder.TokenLoad.loadTokenRank(TokenLoad.java:45)
... 25 more
14/04/22 11:31:03 INFO mapreduce.Job: Job job_local607122693_0003 running
in uber mode : false
14/04/22 11:31:03 INFO mapreduce.Job: map 0% reduce 0%
14/04/22 11:31:03 INFO mapreduce.Job: Job job_local607122693_0003 failed
with state FAILED due to: NA
14/04/22 11:31:03 INFO mapreduce.Job: Counters: 0
java.io.IOException: Job failed!
at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:836)
at
edu.uci.ics.fuzzyjoin.hadoop.FuzzyJoinDriver.run(FuzzyJoinDriver.java:179)
at
edu.uci.ics.fuzzyjoin.hadoop.ridpairs.RIDPairsImproved.main(RIDPairsImproved.java:108)
at edu.uci.ics.fuzzyjoin.hadoop.FuzzyJoin.bib(FuzzyJoin.java:39)
at edu.uci.ics.fuzzyjoin.hadoop.FuzzyJoin.main(FuzzyJoin.java:86)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at
org.apache.hadoop.util.ProgramDriver$ProgramDescription.invoke(ProgramDriver.java:72)
at org.apache.hadoop.util.ProgramDriver.run(ProgramDriver.java:144)
at org.apache.hadoop.util.ProgramDriver.driver(ProgramDriver.java:152)
at
edu.uci.ics.fuzzyjoin.hadoop.FuzzyJoinDriver.main(FuzzyJoinDriver.java:121)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at org.apache.hadoop.util.RunJar.main(RunJar.java:212)
On Tue, Apr 22, 2014 at 11:25 AM, Jay Vyas <ja...@gmail.com> wrote:
> Is this happening in the job client? or the mappers?
>
>
> On Tue, Apr 22, 2014 at 11:21 AM, Natalia Connolly <
> natalia.v.connolly@gmail.com> wrote:
>
>> Hello,
>>
>> I am running Hadoop 2.2.0 in a single-node "cluster" mode. My
>> application dies with the following strange error:
>>
>> Caused by: java.lang.RuntimeException: java.io.FileNotFoundException:
>> file:/tmp/hadoop-hadoop/mapred/local/1398179594286/part-00000 (No such file
>> or directory)
>>
>> This looks like the kind of file that should have been created on the
>> fly (and then deleted). Does anyone know what this error is really a
>> symptom of? Perhaps some permissions issues?
>>
>> Thank you,
>>
>> Natalia
>>
>>
>
>
> --
> Jay Vyas
> http://jayunit100.blogspot.com
>
Re: Strange error in Hadoop 2.2.0: FileNotFoundException: file:/tmp/hadoop-hadoop/mapred/
Posted by Natalia Connolly <na...@gmail.com>.
Hi Jay,
I am really not sure how to answer this question. Here is the full
error:
14/04/22 11:31:02 INFO mapred.LocalJobRunner: Map task executor complete.
14/04/22 11:31:02 WARN mapred.LocalJobRunner: job_local607122693_0003
java.lang.Exception: java.lang.RuntimeException: Error in configuring object
at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:403)
Caused by: java.lang.RuntimeException: Error in configuring object
at
org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:109)
at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:75)
at
org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:133)
at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:425)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341)
at
org.apache.hadoop.mapred.LocalJobRunner$Job$MapTaskRunnable.run(LocalJobRunner.java:235)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:724)
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at
org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:106)
... 10 more
Caused by: java.lang.RuntimeException: Error in configuring object
at
org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:109)
at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:75)
at
org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:133)
at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:38)
... 15 more
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at
org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:106)
... 18 more
Caused by: java.lang.RuntimeException: java.io.FileNotFoundException:
file:/tmp/hadoop-hadoop/mapred/local/1398180662047/part-00000 (No such file
or directory)
at
edu.uci.ics.fuzzyjoin.tokenorder.TokenLoad.loadTokenRank(TokenLoad.java:60)
at
edu.uci.ics.fuzzyjoin.tokenorder.TokenLoad.loadTokenRank(TokenLoad.java:40)
at
edu.uci.ics.fuzzyjoin.hadoop.ridpairs.token.MapSelfJoin.configure(MapSelfJoin.java:98)
... 23 more
Caused by: java.io.FileNotFoundException:
file:/tmp/hadoop-hadoop/mapred/local/1398180662047/part-00000 (No such file
or directory)
at java.io.FileInputStream.open(Native Method)
at java.io.FileInputStream.<init>(FileInputStream.java:146)
at java.io.FileInputStream.<init>(FileInputStream.java:101)
at
edu.uci.ics.fuzzyjoin.tokenorder.TokenLoad.loadTokenRank(TokenLoad.java:45)
... 25 more
14/04/22 11:31:03 INFO mapreduce.Job: Job job_local607122693_0003 running
in uber mode : false
14/04/22 11:31:03 INFO mapreduce.Job: map 0% reduce 0%
14/04/22 11:31:03 INFO mapreduce.Job: Job job_local607122693_0003 failed
with state FAILED due to: NA
14/04/22 11:31:03 INFO mapreduce.Job: Counters: 0
java.io.IOException: Job failed!
at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:836)
at
edu.uci.ics.fuzzyjoin.hadoop.FuzzyJoinDriver.run(FuzzyJoinDriver.java:179)
at
edu.uci.ics.fuzzyjoin.hadoop.ridpairs.RIDPairsImproved.main(RIDPairsImproved.java:108)
at edu.uci.ics.fuzzyjoin.hadoop.FuzzyJoin.bib(FuzzyJoin.java:39)
at edu.uci.ics.fuzzyjoin.hadoop.FuzzyJoin.main(FuzzyJoin.java:86)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at
org.apache.hadoop.util.ProgramDriver$ProgramDescription.invoke(ProgramDriver.java:72)
at org.apache.hadoop.util.ProgramDriver.run(ProgramDriver.java:144)
at org.apache.hadoop.util.ProgramDriver.driver(ProgramDriver.java:152)
at
edu.uci.ics.fuzzyjoin.hadoop.FuzzyJoinDriver.main(FuzzyJoinDriver.java:121)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at org.apache.hadoop.util.RunJar.main(RunJar.java:212)
On Tue, Apr 22, 2014 at 11:25 AM, Jay Vyas <ja...@gmail.com> wrote:
> Is this happening in the job client? or the mappers?
>
>
> On Tue, Apr 22, 2014 at 11:21 AM, Natalia Connolly <
> natalia.v.connolly@gmail.com> wrote:
>
>> Hello,
>>
>> I am running Hadoop 2.2.0 in a single-node "cluster" mode. My
>> application dies with the following strange error:
>>
>> Caused by: java.lang.RuntimeException: java.io.FileNotFoundException:
>> file:/tmp/hadoop-hadoop/mapred/local/1398179594286/part-00000 (No such file
>> or directory)
>>
>> This looks like the kind of file that should have been created on the
>> fly (and then deleted). Does anyone know what this error is really a
>> symptom of? Perhaps some permissions issues?
>>
>> Thank you,
>>
>> Natalia
>>
>>
>
>
> --
> Jay Vyas
> http://jayunit100.blogspot.com
>
Re: Strange error in Hadoop 2.2.0: FileNotFoundException: file:/tmp/hadoop-hadoop/mapred/
Posted by Jay Vyas <ja...@gmail.com>.
Is this happening in the job client? or the mappers?
On Tue, Apr 22, 2014 at 11:21 AM, Natalia Connolly <
natalia.v.connolly@gmail.com> wrote:
> Hello,
>
> I am running Hadoop 2.2.0 in a single-node "cluster" mode. My
> application dies with the following strange error:
>
> Caused by: java.lang.RuntimeException: java.io.FileNotFoundException:
> file:/tmp/hadoop-hadoop/mapred/local/1398179594286/part-00000 (No such file
> or directory)
>
> This looks like the kind of file that should have been created on the
> fly (and then deleted). Does anyone know what this error is really a
> symptom of? Perhaps some permissions issues?
>
> Thank you,
>
> Natalia
>
>
--
Jay Vyas
http://jayunit100.blogspot.com
Re: Strange error in Hadoop 2.2.0: FileNotFoundException: file:/tmp/hadoop-hadoop/mapred/
Posted by Jay Vyas <ja...@gmail.com>.
Is this happening in the job client? or the mappers?
On Tue, Apr 22, 2014 at 11:21 AM, Natalia Connolly <
natalia.v.connolly@gmail.com> wrote:
> Hello,
>
> I am running Hadoop 2.2.0 in a single-node "cluster" mode. My
> application dies with the following strange error:
>
> Caused by: java.lang.RuntimeException: java.io.FileNotFoundException:
> file:/tmp/hadoop-hadoop/mapred/local/1398179594286/part-00000 (No such file
> or directory)
>
> This looks like the kind of file that should have been created on the
> fly (and then deleted). Does anyone know what this error is really a
> symptom of? Perhaps some permissions issues?
>
> Thank you,
>
> Natalia
>
>
--
Jay Vyas
http://jayunit100.blogspot.com
Re: Strange error in Hadoop 2.2.0: FileNotFoundException: file:/tmp/hadoop-hadoop/mapred/
Posted by Jay Vyas <ja...@gmail.com>.
Is this happening in the job client? or the mappers?
On Tue, Apr 22, 2014 at 11:21 AM, Natalia Connolly <
natalia.v.connolly@gmail.com> wrote:
> Hello,
>
> I am running Hadoop 2.2.0 in a single-node "cluster" mode. My
> application dies with the following strange error:
>
> Caused by: java.lang.RuntimeException: java.io.FileNotFoundException:
> file:/tmp/hadoop-hadoop/mapred/local/1398179594286/part-00000 (No such file
> or directory)
>
> This looks like the kind of file that should have been created on the
> fly (and then deleted). Does anyone know what this error is really a
> symptom of? Perhaps some permissions issues?
>
> Thank you,
>
> Natalia
>
>
--
Jay Vyas
http://jayunit100.blogspot.com
Re: Strange error in Hadoop 2.2.0: FileNotFoundException: file:/tmp/hadoop-hadoop/mapred/
Posted by Jay Vyas <ja...@gmail.com>.
Is this happening in the job client? or the mappers?
On Tue, Apr 22, 2014 at 11:21 AM, Natalia Connolly <
natalia.v.connolly@gmail.com> wrote:
> Hello,
>
> I am running Hadoop 2.2.0 in a single-node "cluster" mode. My
> application dies with the following strange error:
>
> Caused by: java.lang.RuntimeException: java.io.FileNotFoundException:
> file:/tmp/hadoop-hadoop/mapred/local/1398179594286/part-00000 (No such file
> or directory)
>
> This looks like the kind of file that should have been created on the
> fly (and then deleted). Does anyone know what this error is really a
> symptom of? Perhaps some permissions issues?
>
> Thank you,
>
> Natalia
>
>
--
Jay Vyas
http://jayunit100.blogspot.com