You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@nutch.apache.org by Georg Kirschner <ge...@gmail.com> on 2009/05/29 15:34:38 UTC

Eclipse Nutch1.0 IOException

Hi,

I tried to hook up Eclipse and Nutch but got following error:

"crawl started in: crawl
rootUrlDir = urls
threads = 10
depth = 3
topN = 50
Injector: starting
Injector: crawlDb: crawl/crawldb
Injector: urlDir: urls
Injector: Converting injected urls to crawl db entries.
Exception in thread "main" java.io.IOException: Job failed!
	at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:1232)
	at org.apache.nutch.crawl.Injector.inject(Injector.java:160)
	at org.apache.nutch.crawl.Crawl.main(Crawl.java:113)"

Can anyone give me a clue here?

Nutch 1.0
Hadoop 0.19.1
Eclipse Ganymede
JDK 1.6.0_13

Thanks

Georg

Re: Eclipse Nutch1.0 IOException

Posted by Georg Kirschner <ge...@gmail.com>.
Thx for the hint, I had a look at the hadoop log too, so it's all clear now!

Thx again

Georg

On Fri, May 29, 2009 at 4:14 PM, Frank McCown <fm...@harding.edu> wrote:
> Look at the section entitled "Java Heap Size problem" at
>
> http://wiki.apache.org/nutch/RunNutchInEclipse1.0
>

Re: Eclipse Nutch1.0 IOException

Posted by Frank McCown <fm...@harding.edu>.
Look at the section entitled "Java Heap Size problem" at

http://wiki.apache.org/nutch/RunNutchInEclipse1.0

Re: Eclipse Nutch1.0 IOException

Posted by Marko Bauhardt <mb...@101tec.com>.
hi georg,
maybe an outofmemory, it is possible that the default memory size is  
to less? look at the logfile, i think hadoop.log, for more details.

marko



On May 29, 2009, at 3:34 PM, Georg Kirschner wrote:

> Hi,
>
> I tried to hook up Eclipse and Nutch but got following error:
>
> "crawl started in: crawl
> rootUrlDir = urls
> threads = 10
> depth = 3
> topN = 50
> Injector: starting
> Injector: crawlDb: crawl/crawldb
> Injector: urlDir: urls
> Injector: Converting injected urls to crawl db entries.
> Exception in thread "main" java.io.IOException: Job failed!
> 	at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:1232)
> 	at org.apache.nutch.crawl.Injector.inject(Injector.java:160)
> 	at org.apache.nutch.crawl.Crawl.main(Crawl.java:113)"
>
> Can anyone give me a clue here?
>
> Nutch 1.0
> Hadoop 0.19.1
> Eclipse Ganymede
> JDK 1.6.0_13
>
> Thanks
>
> Georg
>