You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@nutch.apache.org by Koch Martina <Ko...@huberverlag.de> on 2008/09/25 11:30:40 UTC

IOException when Crawling

Hi all,
Whenever I run the Nutch crawler I get the following error message at
the end:

Exception in thread "main" java.IOException: Job failed!
at org.apache.hadoop.mapred.JobClient.runJob
at org.apache.nutch.indexer.Indexer.index
at org.apache.nutch.crawlCrawl.main

Does anybody know why I get these error messages and how to solve them?
Thanks, Martina

RE: IOException when Crawling

Posted by Edward Quick <ed...@hotmail.com>.
In my experience that usually means you've run out of space.

Ed.

> From: Koch@huberverlag.de
> To: nutch-user@lucene.apache.org
> Date: Thu, 25 Sep 2008 11:30:40 +0200
> Subject: IOException when Crawling
> 
> Hi all,
> Whenever I run the Nutch crawler I get the following error message at
> the end:
> 
> Exception in thread "main" java.IOException: Job failed!
> at org.apache.hadoop.mapred.JobClient.runJob
> at org.apache.nutch.indexer.Indexer.index
> at org.apache.nutch.crawlCrawl.main
> 
> Does anybody know why I get these error messages and how to solve them?
> Thanks, Martina

_________________________________________________________________
Get all your favourite content with the slick new MSN Toolbar - FREE
http://clk.atdmt.com/UKM/go/111354027/direct/01/

Re: IOException when Crawling

Posted by Dennis Kubes <ku...@apache.org>.
It actually could be a number of different things.  We will need to see 
more detailed logs from the hadoop.log file to help further.

Dennis

Koch Martina wrote:
> Hi all,
> Whenever I run the Nutch crawler I get the following error message at
> the end:
> 
> Exception in thread "main" java.IOException: Job failed!
> at org.apache.hadoop.mapred.JobClient.runJob
> at org.apache.nutch.indexer.Indexer.index
> at org.apache.nutch.crawlCrawl.main
> 
> Does anybody know why I get these error messages and how to solve them?
> Thanks, Martina
>