You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@nutch.apache.org by Alexis Votta <al...@gmail.com> on 2007/11/27 15:11:03 UTC
NullPointerException with trunk
I have updated my copy of Nutch from subversion to revision 597822.
With minimal settings like nutch-site.xml, crawl-urlfilter.txt and a
crawl with the command: bin/nutch crawl urls -dir crawl -depth 2 -topN
10 -threads 3 the crawl runs fine.
But on trying to verify the crawl with this command: bin/nutch
org.apache.nutch.searcher.NutchBean alexis
I get this error
Total hits: 11
Exception in thread "main" java.lang.RuntimeException:
java.lang.NullPointerException
at org.apache.nutch.searcher.FetchedSegments.getSummary(FetchedSegments.java:204)
at org.apache.nutch.searcher.NutchBean.getSummary(NutchBean.java:342)
at org.apache.nutch.searcher.NutchBean.main(NutchBean.java:393)
Caused by: java.lang.NullPointerException
at org.apache.nutch.searcher.FetchedSegments.getSummary(FetchedSegments.java:159)
at org.apache.nutch.searcher.FetchedSegments$SummaryThread.run(FetchedSegments.java:177)
Is this some bug in trunk?
Re: NullPointerException with trunk
Posted by Dennis Kubes <ku...@apache.org>.
Yes, this is currently a bug in trunk which errors out when the content
for a given url is null. This bug is in process of being fixed.
Dennis
Alexis Votta wrote:
> I have updated my copy of Nutch from subversion to revision 597822.
> With minimal settings like nutch-site.xml, crawl-urlfilter.txt and a
> crawl with the command: bin/nutch crawl urls -dir crawl -depth 2 -topN
> 10 -threads 3 the crawl runs fine.
>
> But on trying to verify the crawl with this command: bin/nutch
> org.apache.nutch.searcher.NutchBean alexis
> I get this error
>
> Total hits: 11
> Exception in thread "main" java.lang.RuntimeException:
> java.lang.NullPointerException
> at org.apache.nutch.searcher.FetchedSegments.getSummary(FetchedSegments.java:204)
> at org.apache.nutch.searcher.NutchBean.getSummary(NutchBean.java:342)
> at org.apache.nutch.searcher.NutchBean.main(NutchBean.java:393)
> Caused by: java.lang.NullPointerException
> at org.apache.nutch.searcher.FetchedSegments.getSummary(FetchedSegments.java:159)
> at org.apache.nutch.searcher.FetchedSegments$SummaryThread.run(FetchedSegments.java:177)
>
> Is this some bug in trunk?
Re: NullPointerException with trunk
Posted by Dennis Kubes <ku...@apache.org>.
So it breaks on the upgrade to Hadoop 0.15. Will look into it.
Dennis
Susam Pal wrote:
> I came across this error too while working on NUTCH-559. I did a
> -depth 2 -topN 5 crawl of http://en.wikipedia.org/ and I am unable to
> get results for any query due to this error. I was just going through
> all the previous commits. The last revision that works fine is
> #589654.
>
> Regards,
> Susam Pal
>
> On Nov 27, 2007 7:41 PM, Alexis Votta <al...@gmail.com> wrote:
>> I have updated my copy of Nutch from subversion to revision 597822.
>> With minimal settings like nutch-site.xml, crawl-urlfilter.txt and a
>> crawl with the command: bin/nutch crawl urls -dir crawl -depth 2 -topN
>> 10 -threads 3 the crawl runs fine.
>>
>> But on trying to verify the crawl with this command: bin/nutch
>> org.apache.nutch.searcher.NutchBean alexis
>> I get this error
>>
>> Total hits: 11
>> Exception in thread "main" java.lang.RuntimeException:
>> java.lang.NullPointerException
>> at org.apache.nutch.searcher.FetchedSegments.getSummary(FetchedSegments.java:204)
>> at org.apache.nutch.searcher.NutchBean.getSummary(NutchBean.java:342)
>> at org.apache.nutch.searcher.NutchBean.main(NutchBean.java:393)
>> Caused by: java.lang.NullPointerException
>> at org.apache.nutch.searcher.FetchedSegments.getSummary(FetchedSegments.java:159)
>> at org.apache.nutch.searcher.FetchedSegments$SummaryThread.run(FetchedSegments.java:177)
>>
>> Is this some bug in trunk?
>>
Re: NullPointerException with trunk
Posted by Susam Pal <su...@gmail.com>.
I came across this error too while working on NUTCH-559. I did a
-depth 2 -topN 5 crawl of http://en.wikipedia.org/ and I am unable to
get results for any query due to this error. I was just going through
all the previous commits. The last revision that works fine is
#589654.
Regards,
Susam Pal
On Nov 27, 2007 7:41 PM, Alexis Votta <al...@gmail.com> wrote:
> I have updated my copy of Nutch from subversion to revision 597822.
> With minimal settings like nutch-site.xml, crawl-urlfilter.txt and a
> crawl with the command: bin/nutch crawl urls -dir crawl -depth 2 -topN
> 10 -threads 3 the crawl runs fine.
>
> But on trying to verify the crawl with this command: bin/nutch
> org.apache.nutch.searcher.NutchBean alexis
> I get this error
>
> Total hits: 11
> Exception in thread "main" java.lang.RuntimeException:
> java.lang.NullPointerException
> at org.apache.nutch.searcher.FetchedSegments.getSummary(FetchedSegments.java:204)
> at org.apache.nutch.searcher.NutchBean.getSummary(NutchBean.java:342)
> at org.apache.nutch.searcher.NutchBean.main(NutchBean.java:393)
> Caused by: java.lang.NullPointerException
> at org.apache.nutch.searcher.FetchedSegments.getSummary(FetchedSegments.java:159)
> at org.apache.nutch.searcher.FetchedSegments$SummaryThread.run(FetchedSegments.java:177)
>
> Is this some bug in trunk?
>