You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@nutch.apache.org by John Mendenhall <jo...@surfutopia.net> on 2008/03/16 00:38:37 UTC
nutch 0.9, tomcat 6.0.14, nutchbean okay, tomcat search error
I am running nutch 0.9, with tomcat 6.0.14.
When I use the NutchBean to search the index,
it works fine. I get back results, no errors.
I have used tomcat before and it has worked
fine.
Now I am getting an error searching through
tomcat. This is the tomcat error I am seeing
in the catalina.out log file:
-----
2008-03-15 15:38:38,715 INFO NutchBean - query request from 192.168.245.58
2008-03-15 15:38:38,717 INFO NutchBean - query: penasquitos
2008-03-15 15:38:38,717 INFO NutchBean - lang: en
Mar 15, 2008 3:38:41 PM org.apache.catalina.core.StandardWrapperValve invoke
SEVERE: Servlet.service() for servlet jsp threw exception
java.lang.NullPointerException
at org.apache.nutch.searcher.FetchedSegments.getSummary(FetchedSegments.java:159)
at org.apache.nutch.searcher.FetchedSegments$SummaryThread.run(FetchedSegments.java:177)
-----
When I run a search using the NutchBean, I
see debug log entries in the hadoop.log.
When I run the search using Tomcat, I never
see any hadoop.log entires.
We have 1.4 million indexed pages, taking
up 31gb for the nutch/crawl directory.
The search term doesn't matter.
My guess is it may be a memory error,
but I am not seeing it anywhere.
Is there a place where I can set the memory
footprint for tomcat to use more memory?
Or, is there another place I should be looking?
Thanks in advance for any pointers or assistance.
JohnM
--
john mendenhall
john@surfutopia.net
surf utopia
internet services
Re: nutch 0.9, tomcat 6.0.14, nutchbean okay, tomcat search error
Posted by Vinci <vi...@polyu.edu.hk>.
Hi,
congrat:)
btw, unless you set permission other then 755, no much permission thing you
need to care if you use tomcat.
one question: did you changed the plugin list? What plugin are you using? I
wonder how can you get the language of your query...
John Mendenhall wrote:
>
>> please check the path of the search.dir in property file (nutch-site.xml)
>> located in webapps/nutch_depoly_directory/WEB-INF/classes, check it is
>> accessable or not.
>>
>> if you use absolute path then this will be another problem
>
> Super! Thanks a bunch! That was it.
> The property is actually serverer.dir.
> We always use absolute paths since it helps tremendously
> not having to worry about where one is when the process is
> started.
>
> We had moved it from one matchine to another and had
> forgotten to make sure the tomcat process owner 'tomcat'
> was in the nutch group 'nutch'. Fixed that and it works
> like a charm.
>
> Thanks again!
>
> JohnM
>
> --
> john mendenhall
> john@surfutopia.net
> surf utopia
> internet services
>
>
--
View this message in context: http://www.nabble.com/nutch-0.9%2C-tomcat-6.0.14%2C-nutchbean-okay%2C-tomcat-search-error-tp16073740p16075816.html
Sent from the Nutch - User mailing list archive at Nabble.com.
Re: nutch 0.9, tomcat 6.0.14, nutchbean okay, tomcat search error
Posted by John Mendenhall <jo...@surfutopia.net>.
> please check the path of the search.dir in property file (nutch-site.xml)
> located in webapps/nutch_depoly_directory/WEB-INF/classes, check it is
> accessable or not.
>
> if you use absolute path then this will be another problem
Super! Thanks a bunch! That was it.
The property is actually serverer.dir.
We always use absolute paths since it helps tremendously
not having to worry about where one is when the process is
started.
We had moved it from one matchine to another and had
forgotten to make sure the tomcat process owner 'tomcat'
was in the nutch group 'nutch'. Fixed that and it works
like a charm.
Thanks again!
JohnM
--
john mendenhall
john@surfutopia.net
surf utopia
internet services
Re: nutch 0.9, tomcat 6.0.14, nutchbean okay, tomcat search error
Posted by Vinci <vi...@polyu.edu.hk>.
Hi,
please check the path of the search.dir in property file located in
webapps/nutch_depoly_directory/WEB-INF/classes, check it is accessable or
not.
if you use absolute path then this will be another problem
Hope it help
John Mendenhall wrote:
>
> I am running nutch 0.9, with tomcat 6.0.14.
> When I use the NutchBean to search the index,
> it works fine. I get back results, no errors.
> I have used tomcat before and it has worked
> fine.
>
> Now I am getting an error searching through
> tomcat. This is the tomcat error I am seeing
> in the catalina.out log file:
>
> -----
> 2008-03-15 15:38:38,715 INFO NutchBean - query request from
> 192.168.245.58
> 2008-03-15 15:38:38,717 INFO NutchBean - query: penasquitos
> 2008-03-15 15:38:38,717 INFO NutchBean - lang: en
> Mar 15, 2008 3:38:41 PM org.apache.catalina.core.StandardWrapperValve
> invoke
> SEVERE: Servlet.service() for servlet jsp threw exception
> java.lang.NullPointerException
> at
> org.apache.nutch.searcher.FetchedSegments.getSummary(FetchedSegments.java:159)
> at
> org.apache.nutch.searcher.FetchedSegments$SummaryThread.run(FetchedSegments.java:177)
> -----
>
> When I run a search using the NutchBean, I
> see debug log entries in the hadoop.log.
> When I run the search using Tomcat, I never
> see any hadoop.log entires.
>
> We have 1.4 million indexed pages, taking
> up 31gb for the nutch/crawl directory.
>
> The search term doesn't matter.
>
> My guess is it may be a memory error,
> but I am not seeing it anywhere.
> Is there a place where I can set the memory
> footprint for tomcat to use more memory?
>
> Or, is there another place I should be looking?
>
> Thanks in advance for any pointers or assistance.
>
> JohnM
>
> --
> john mendenhall
> john@surfutopia.net
> surf utopia
> internet services
>
>
--
View this message in context: http://www.nabble.com/nutch-0.9%2C-tomcat-6.0.14%2C-nutchbean-okay%2C-tomcat-search-error-tp16073740p16075186.html
Sent from the Nutch - User mailing list archive at Nabble.com.