You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@nutch.apache.org by MyD <my...@googlemail.com> on 2009/04/10 14:11:02 UTC
NullPointerException mapred
Hi @ all,
I am using the newest trunk source code. I get every time this error
msg:
2009-04-10 20:08:23,816 INFO indexer.Indexer - Indexer: done
2009-04-10 20:08:23,817 INFO indexer.DeleteDuplicates - Dedup: starting
2009-04-10 20:08:23,818 INFO indexer.DeleteDuplicates - Dedup: adding
indexes in: crawl.dirs/crawl.wikicfp.test/indexes
2009-04-10 20:08:23,828 WARN mapred.JobClient - Use
GenericOptionsParser for parsing the arguments. Applications should
implement Tool for the
same.
2009-04-10 20:08:24,987 WARN mapred.LocalJobRunner - job_local_0014
java.lang.NullPointerException
at org.apache.hadoop.io.Text.encode(Text.java:388)
at org.apache.hadoop.io.Text.set(Text.java:178)
at org.apache.nutch.indexer.DeleteDuplicates$InputFormat
$DDRecordReader.next(DeleteDuplicates.java:191)
at org.apache.nutch.indexer.DeleteDuplicates$InputFormat
$DDRecordReader.next(DeleteDuplicates.java:157)
at org.apache.hadoop.mapred.MapTask
$TrackedRecordReader.moveToNext(MapTask.java:192)
at org.apache.hadoop.mapred.MapTask
$TrackedRecordReader.next(MapTask.java:176)
at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:48)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:342)
at org.apache.hadoop.mapred.LocalJobRunner
$Job.run(LocalJobRunner.java:138)
Any idea? Thanks in advance.
Regards,
MyD
Re: NullPointerException mapred
Posted by Markus Haense <mh...@gmail.com>.
It looks like when you write your own indexer plugin and forget to add
the field url in a doc then you get this kind of error :/
Regards,
MyD
On Apr 10, 2009, at 8:11 PM, MyD wrote:
> Hi @ all,
>
> I am using the newest trunk source code. I get every time this error
> msg:
>
> 2009-04-10 20:08:23,816 INFO indexer.Indexer - Indexer: done
> 2009-04-10 20:08:23,817 INFO indexer.DeleteDuplicates - Dedup:
> starting
> 2009-04-10 20:08:23,818 INFO indexer.DeleteDuplicates - Dedup:
> adding indexes in: crawl.dirs/crawl.wikicfp.test/indexes
> 2009-04-10 20:08:23,828 WARN mapred.JobClient - Use
> GenericOptionsParser for parsing the arguments. Applications should
> implement Tool for the
> same.
> 2009-04-10 20:08:24,987 WARN mapred.LocalJobRunner - job_local_0014
> java.lang.NullPointerException
> at org.apache.hadoop.io.Text.encode(Text.java:388)
> at org.apache.hadoop.io.Text.set(Text.java:178)
> at org.apache.nutch.indexer.DeleteDuplicates$InputFormat
> $DDRecordReader.next(DeleteDuplicates.java:191)
> at org.apache.nutch.indexer.DeleteDuplicates$InputFormat
> $DDRecordReader.next(DeleteDuplicates.java:157)
> at org.apache.hadoop.mapred.MapTask
> $TrackedRecordReader.moveToNext(MapTask.java:192)
> at org.apache.hadoop.mapred.MapTask
> $TrackedRecordReader.next(MapTask.java:176)
> at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:48)
> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:342)
> at org.apache.hadoop.mapred.LocalJobRunner
> $Job.run(LocalJobRunner.java:138)
>
>
> Any idea? Thanks in advance.
>
> Regards,
> MyD