You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-user@hadoop.apache.org by Emmanuel <jo...@gmail.com> on 2007/12/21 12:15:37 UTC

Error when run in local mode

Hi Guys,

I installedthe trunk version of NUTCH under windows with cygwin. I tried to
run it but it failed every time due to en error in hadoop framework:
007-12-21 16:16:30,908 INFO  mapred.JobClient -  map 0% reduce 0%
2007-12-21 16:16:35,923 INFO  mapred.LocalJobRunner -
file:/c:/Workarea/workspace/se/urls/bourso:0+26
2007-12-21 16:16:36,908 INFO  mapred.JobClient -  map 100% reduce 0%
2007-12-21 16:16:51,626 INFO  mapred.LocalJobRunner -
file:/c:/Workarea/workspace/se/urls/bourso:0+26
2007-12-21 16:16:51,626 INFO  mapred.TaskRunner - Task 'map_0000' done.
2007-12-21 16:16:51,642 DEBUG conf.Configuration - java.io.IOException:
config(config)
    at org.apache.hadoop.conf.Configuration.<init>(Configuration.java:158)
    at org.apache.hadoop.mapred.JobConf.<init>(JobConf.java:132)
    at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:159)


2007-12-21 16:16:51,642 DEBUG mapred.TaskRunner - reduce_7zz4i0
Progress/ping thread started
2007-12-21 16:16:51,673 INFO  mapred.LocalJobRunner - reduce > reduce
2007-12-21 16:16:51,673 INFO  mapred.TaskRunner - Task 'reduce_7zz4i0' done.

2007-12-21 16:16:51,689 WARN  mapred.LocalJobRunner - job_local_1
java.io.IOException: Target
file:/c:/tmp/hadoop-magy/mapred/temp/inject-temp-1472461814/_reduce_7zz4i0/part-00000
already exists
    at org.apache.hadoop.fs.FileUtil.checkDest(FileUtil.java:246)
    at org.apache.hadoop.fs.FileUtil.copy(FileUtil.java:125)
    at org.apache.hadoop.fs.FileUtil.copy(FileUtil.java:116)
    at org.apache.hadoop.fs.RawLocalFileSystem.rename(
RawLocalFileSystem.java:180)
    at org.apache.hadoop.fs.ChecksumFileSystem.rename(
ChecksumFileSystem.java:394)
    at org.apache.hadoop.mapred.Task.moveTaskOutputs(Task.java:452)
    at org.apache.hadoop.mapred.Task.moveTaskOutputs(Task.java:469)
    at org.apache.hadoop.mapred.Task.saveTaskOutput(Task.java:426)
    at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:165)

2007-12-21 16:16:51,908 FATAL crawl.Injector - Injector: java.io.IOException:
Job failed!
    at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:831)
    at org.apache.nutch.crawl.Injector.inject(Injector.java:162)
    at org.apache.nutch.crawl.Injector.run(Injector.java:192)
    at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
    at org.apache.hadoop.util.ToolBase.doMain(ToolBase.java:54)
    at org.apache.nutch.crawl.Injector.main(Injector.java:182)

Is there any issue or did i done something wrong ?

Thanks for your help