java.io.IOException: Job failed

[Gal Nitzan <gn...@usa.net>]

Hi,

I am using trunk. while trying to crawl I get the following:



in crawl log:

051229 235114 Dedup: adding indexes in: crawl/indexes
051229 235114 parsing file:/home/nutchuser/nutch/conf/nutch-default.xml
051229 235114 parsing file:/home/nutchuser/nutch/conf/crawl-tool.xml
051229 235114 parsing file:/home/nutchuser/nutch/conf/mapred-default.xml
051229 235114 parsing file:/home/nutchuser/nutch/conf/mapred-default.xml
051229 235114 parsing file:/home/nutchuser/nutch/conf/nutch-site.xml
051229 235115 Running job: job_r1bmnj
051229 235116  map 0%
051229 235138  reduce 100%
Exception in thread "main" java.io.IOException: Job failed!
        at org.apache.nutch.mapred.JobClient.runJob(JobClient.java:308)
        at
org.apache.nutch.indexer.DeleteDuplicates.dedup(DeleteDuplicates.jav
a:309)
        at org.apache.nutch.crawl.Crawl.main(Crawl.java:123)



in tasktracker log:

050825 100222 task_m_ns3ehv  Error running child
050825 100222 task_m_ns3ehv java.lang.ArithmeticException: / by zero
050825 100222 task_m_ns3ehv     at
org.apache.nutch.indexer.DeleteDuplicates
$1.getPos(DeleteDuplicates.java:193)
050825 100222 task_m_ns3ehv     at org.apache.nutch.mapred.MapTask
$2.next(MapTask.java:102)
050825 100222 task_m_ns3ehv     at
org.apache.nutch.mapred.MapRunner.run(MapRunner.java:48)
050825 100222 task_m_ns3ehv     at
org.apache.nutch.mapred.MapTask.run(MapTask.java:116)
050825 100222 task_m_ns3ehv     at org.apache.nutch.mapred.TaskTracker
$Child.main(TaskTracker.java:604)

Regards,

Gal

Re: java.io.IOException: Job failed

[Doug Cutting <cu...@nutch.org>]

Gal Nitzan wrote:
> I am using trunk. while trying to crawl I get the following:

[ ...]

> 050825 100222 task_m_ns3ehv  Error running child
> 050825 100222 task_m_ns3ehv java.lang.ArithmeticException: / by zero
> 050825 100222 task_m_ns3ehv     at
> org.apache.nutch.indexer.DeleteDuplicates
> $1.getPos(DeleteDuplicates.java:193)

I just fixed this.

Doug