You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@nutch.apache.org by Marek Bachmann <m....@uni-kassel.de> on 2011/10/12 01:35:38 UTC

Strange Error while trying to read a specific url from crawl db (nutch in deploy mode)

Can anyone tell me what is going wrong here?

Thanks :-)


nutch@hrz-pc318:/nutch/nutch13/runtime/deploy/bin$ ./nutch readdb 
crawldb -url http://www.uni-kassel.de/
11/10/12 01:25:39 INFO util.NativeCodeLoader: Loaded the native-hadoop 
library
11/10/12 01:25:39 INFO zlib.ZlibFactory: Successfully loaded & 
initialized native-zlib library
11/10/12 01:25:39 INFO compress.CodecPool: Got brand-new decompressor
11/10/12 01:25:39 INFO compress.CodecPool: Got brand-new decompressor
11/10/12 01:25:39 INFO compress.CodecPool: Got brand-new decompressor
11/10/12 01:25:39 INFO compress.CodecPool: Got brand-new decompressor
11/10/12 01:25:39 INFO compress.CodecPool: Got brand-new decompressor
11/10/12 01:25:39 INFO compress.CodecPool: Got brand-new decompressor
11/10/12 01:25:39 INFO compress.CodecPool: Got brand-new decompressor
11/10/12 01:25:39 INFO compress.CodecPool: Got brand-new decompressor
Exception in thread "main" java.io.IOException: can't find class: 
org.apache.nutch.protocol.ProtocolStatus because 
org.apache.nutch.protocol.ProtocolStatus
         at 
org.apache.hadoop.io.AbstractMapWritable.readFields(AbstractMapWritable.java:204)
         at 
org.apache.hadoop.io.MapWritable.readFields(MapWritable.java:146)
         at 
org.apache.nutch.crawl.CrawlDatum.readFields(CrawlDatum.java:278)
         at 
org.apache.hadoop.io.SequenceFile$Reader.getCurrentValue(SequenceFile.java:1751)
         at org.apache.hadoop.io.MapFile$Reader.get(MapFile.java:524)
         at 
org.apache.hadoop.mapred.MapFileOutputFormat.getEntry(MapFileOutputFormat.java:105)
         at org.apache.nutch.crawl.CrawlDbReader.get(CrawlDbReader.java:380)
         at 
org.apache.nutch.crawl.CrawlDbReader.readUrl(CrawlDbReader.java:386)
         at 
org.apache.nutch.crawl.CrawlDbReader.main(CrawlDbReader.java:511)
         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
         at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
         at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
         at java.lang.reflect.Method.invoke(Method.java:597)
         at org.apache.hadoop.util.RunJar.main(RunJar.java:156)

Re: Strange Error while trying to read a specific url from crawl db (nutch in deploy mode)

Posted by Markus Jelsma <ma...@openindex.io>.
A nasty issue:
https://issues.apache.org/jira/browse/NUTCH-1084

> Can anyone tell me what is going wrong here?
> 
> Thanks :-)
> 
> 
> nutch@hrz-pc318:/nutch/nutch13/runtime/deploy/bin$ ./nutch readdb
> crawldb -url http://www.uni-kassel.de/
> 11/10/12 01:25:39 INFO util.NativeCodeLoader: Loaded the native-hadoop
> library
> 11/10/12 01:25:39 INFO zlib.ZlibFactory: Successfully loaded &
> initialized native-zlib library
> 11/10/12 01:25:39 INFO compress.CodecPool: Got brand-new decompressor
> 11/10/12 01:25:39 INFO compress.CodecPool: Got brand-new decompressor
> 11/10/12 01:25:39 INFO compress.CodecPool: Got brand-new decompressor
> 11/10/12 01:25:39 INFO compress.CodecPool: Got brand-new decompressor
> 11/10/12 01:25:39 INFO compress.CodecPool: Got brand-new decompressor
> 11/10/12 01:25:39 INFO compress.CodecPool: Got brand-new decompressor
> 11/10/12 01:25:39 INFO compress.CodecPool: Got brand-new decompressor
> 11/10/12 01:25:39 INFO compress.CodecPool: Got brand-new decompressor
> Exception in thread "main" java.io.IOException: can't find class:
> org.apache.nutch.protocol.ProtocolStatus because
> org.apache.nutch.protocol.ProtocolStatus
>          at
> org.apache.hadoop.io.AbstractMapWritable.readFields(AbstractMapWritable.jav
> a:204) at
> org.apache.hadoop.io.MapWritable.readFields(MapWritable.java:146)
>          at
> org.apache.nutch.crawl.CrawlDatum.readFields(CrawlDatum.java:278)
>          at
> org.apache.hadoop.io.SequenceFile$Reader.getCurrentValue(SequenceFile.java:
> 1751) at org.apache.hadoop.io.MapFile$Reader.get(MapFile.java:524) at
> org.apache.hadoop.mapred.MapFileOutputFormat.getEntry(MapFileOutputFormat.j
> ava:105) at
> org.apache.nutch.crawl.CrawlDbReader.get(CrawlDbReader.java:380) at
> org.apache.nutch.crawl.CrawlDbReader.readUrl(CrawlDbReader.java:386)
>          at
> org.apache.nutch.crawl.CrawlDbReader.main(CrawlDbReader.java:511)
>          at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>          at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:3
> 9) at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImp
> l.java:25) at java.lang.reflect.Method.invoke(Method.java:597)
>          at org.apache.hadoop.util.RunJar.main(RunJar.java:156)