You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@nutch.apache.org by elangovan anbalahan <am...@gmail.com> on 2008/12/02 01:09:10 UTC

Problem with Nutch search

Hello,

I am facing a problem with my Nutch search. when i am searching for
something in the crawlled pages, i am getting '0' results, This is the case
when i am running search on Fedora.

But when i do search on same crawlled pages from vista (Using cygwin)
everything is proper, and the results are correct.

Please help me out with this problem, i have been bangin my head on this one
for last one day but no success.


Thanks,
Elan

Re: Problem with Nutch search

Posted by elangovan anbalahan <am...@gmail.com>.
Hi, Thanks a lot for the all the suggessions .

My problem got solved in an unusual way, i tried everything but still
couldnt find out the reason why i was not able to perform search. Out of
desperation i moved the directory that has the indexes to another location
from desktop in my fedora OS, (/usr/share/tomcat6/webapps/nutch-0.9/) and it
worked !

Elan


On Wed, Dec 3, 2008 at 2:55 PM, Alexander Aristov <
alexander.aristov@gmail.com> wrote:

> One more idea.
>
> if you are sure that path is correct then you might check index.
> in the nutch index folder there might be two sub folders - index and
> indexes
> which are lucene indexes.
>
> One for merged index and second for multiple indexes.
>
> check sizes first of all - if they are about zero size then you had
> problems
> with previous steps and your index has not been created.
>
> if size is OK then you need to check which index you are using.
>
> The thing is if you have the merged index and the multiple index at the
> same
> time the first folder has a priority and multiple indexes are not used.
>
> Maybe this is your case.
>
> Alexander
>
>
> 2008/12/3 elangovan anbalahan <am...@gmail.com>
>
> > Hey thanks a lot for the information, But i had already checked that, i
> > have not made any changes to nutch-default. Just added a property in
> > nutch-site.xml.
> >
> > Please suggest me other directions to troubleshoot, this problem. its
> over
> > 2 days now and i am not able to solve this one.
> >
> > I am using Fedora 10. The same installation when i do it in windows, the
> > search work absolutely fine. Please help..!!
> >
> > On Tue, Dec 2, 2008 at 4:48 PM, Kalaimathan Mahenthiran <
> > mathan55@gmail.com> wrote:
> >
> >> Hello,
> >>
> >> I think you should check your nutch-default.xml, or nutch-site.xml
> config
> >> file and verify where you searcher path is pointing to. Even though this
> >> is
> >> trivial. This path must be pointing to where your index, segments,
> linkdb
> >> dirs should be. Hope that helps.
> >>
> >> Mathan
> >>
> >> There should be a xml property
> >>
> >> On Mon, Dec 1, 2008 at 7:09 PM, elangovan anbalahan
> >> <am...@gmail.com>wrote:
> >>
> >> > Hello,
> >> >
> >> > I am facing a problem with my Nutch search. when i am searching for
> >> > something in the crawlled pages, i am getting '0' results, This is the
> >> case
> >> > when i am running search on Fedora.
> >> >
> >> > But when i do search on same crawlled pages from vista (Using cygwin)
> >> > everything is proper, and the results are correct.
> >> >
> >> > Please help me out with this problem, i have been bangin my head on
> this
> >> > one
> >> > for last one day but no success.
> >> >
> >> >
> >> > Thanks,
> >> > Elan
> >> >
> >>
> >
> >
>
>
> --
> Best Regards
> Alexander Aristov
>

Re: Problem with Nutch search

Posted by Alexander Aristov <al...@gmail.com>.
One more idea.

if you are sure that path is correct then you might check index.
in the nutch index folder there might be two sub folders - index and indexes
which are lucene indexes.

One for merged index and second for multiple indexes.

check sizes first of all - if they are about zero size then you had problems
with previous steps and your index has not been created.

if size is OK then you need to check which index you are using.

The thing is if you have the merged index and the multiple index at the same
time the first folder has a priority and multiple indexes are not used.

Maybe this is your case.

Alexander


2008/12/3 elangovan anbalahan <am...@gmail.com>

> Hey thanks a lot for the information, But i had already checked that, i
> have not made any changes to nutch-default. Just added a property in
> nutch-site.xml.
>
> Please suggest me other directions to troubleshoot, this problem. its over
> 2 days now and i am not able to solve this one.
>
> I am using Fedora 10. The same installation when i do it in windows, the
> search work absolutely fine. Please help..!!
>
> On Tue, Dec 2, 2008 at 4:48 PM, Kalaimathan Mahenthiran <
> mathan55@gmail.com> wrote:
>
>> Hello,
>>
>> I think you should check your nutch-default.xml, or nutch-site.xml config
>> file and verify where you searcher path is pointing to. Even though this
>> is
>> trivial. This path must be pointing to where your index, segments, linkdb
>> dirs should be. Hope that helps.
>>
>> Mathan
>>
>> There should be a xml property
>>
>> On Mon, Dec 1, 2008 at 7:09 PM, elangovan anbalahan
>> <am...@gmail.com>wrote:
>>
>> > Hello,
>> >
>> > I am facing a problem with my Nutch search. when i am searching for
>> > something in the crawlled pages, i am getting '0' results, This is the
>> case
>> > when i am running search on Fedora.
>> >
>> > But when i do search on same crawlled pages from vista (Using cygwin)
>> > everything is proper, and the results are correct.
>> >
>> > Please help me out with this problem, i have been bangin my head on this
>> > one
>> > for last one day but no success.
>> >
>> >
>> > Thanks,
>> > Elan
>> >
>>
>
>


-- 
Best Regards
Alexander Aristov

Re: Problem with Nutch search

Posted by elangovan anbalahan <am...@gmail.com>.
Hey thanks a lot for the information, But i had already checked that, i have
not made any changes to nutch-default. Just added a property in
nutch-site.xml.

Please suggest me other directions to troubleshoot, this problem. its over 2
days now and i am not able to solve this one.

I am using Fedora 10. The same installation when i do it in windows, the
search work absolutely fine. Please help..!!

On Tue, Dec 2, 2008 at 4:48 PM, Kalaimathan Mahenthiran
<ma...@gmail.com>wrote:

> Hello,
>
> I think you should check your nutch-default.xml, or nutch-site.xml config
> file and verify where you searcher path is pointing to. Even though this is
> trivial. This path must be pointing to where your index, segments, linkdb
> dirs should be. Hope that helps.
>
> Mathan
>
> There should be a xml property
>
> On Mon, Dec 1, 2008 at 7:09 PM, elangovan anbalahan
> <am...@gmail.com>wrote:
>
> > Hello,
> >
> > I am facing a problem with my Nutch search. when i am searching for
> > something in the crawlled pages, i am getting '0' results, This is the
> case
> > when i am running search on Fedora.
> >
> > But when i do search on same crawlled pages from vista (Using cygwin)
> > everything is proper, and the results are correct.
> >
> > Please help me out with this problem, i have been bangin my head on this
> > one
> > for last one day but no success.
> >
> >
> > Thanks,
> > Elan
> >
>

Re: Problem with Nutch search

Posted by Kalaimathan Mahenthiran <ma...@gmail.com>.
Hello,

I think you should check your nutch-default.xml, or nutch-site.xml config
file and verify where you searcher path is pointing to. Even though this is
trivial. This path must be pointing to where your index, segments, linkdb
dirs should be. Hope that helps.

Mathan

There should be a xml property

On Mon, Dec 1, 2008 at 7:09 PM, elangovan anbalahan
<am...@gmail.com>wrote:

> Hello,
>
> I am facing a problem with my Nutch search. when i am searching for
> something in the crawlled pages, i am getting '0' results, This is the case
> when i am running search on Fedora.
>
> But when i do search on same crawlled pages from vista (Using cygwin)
> everything is proper, and the results are correct.
>
> Please help me out with this problem, i have been bangin my head on this
> one
> for last one day but no success.
>
>
> Thanks,
> Elan
>

Re: Problem with Nutch search

Posted by elangovan anbalahan <am...@gmail.com>.
Thanks a lot for the checklist, will get back to you once i am done with
this.

On Tue, Dec 2, 2008 at 11:38 PM, Dennis Kubes <ku...@apache.org> wrote:

> If it is working on windows and not linux my guess is that it is either a
> classpath or a relative path issue.  Here is how I would troubleshoot:
>
> 1) Check where searcher.dir is pointing to, make sure that is a fully
> qualified path.  If running distributed search it should point to a folder
> containing a search-servers.xml file, otherwise should point to an indexes
> parent location.
> 2) Make sure any uppercase / lowercase differences are resolved.
> 3) Make sure you are pointing to the parent of the indexes directory. That
> parent should contain a segments folder, an indexes folder, and possibly a
> linkdb folder.
> 4) Make sure plugins folder exist.
> 5) Make sure you are using the same version of Nutch and Hadoop and the
> plugins for both indexing and serving.
> 6) Make sure you are using the same java version for indexing and serving.
> 7) Try using NutchBean to do a search and see if results are returned.
> 8) Try doing a search that should return anything, like "http".
> 9) Set log4j.properties logging to all and check logs for any errors.
> 10) Did all that and still not seeing anything, try changing the version of
> the servlet container you are using (I have seen problems with some
> intermediate builds of tomcat).
>
> Still need more help.  Give more info and we might be able to narrow it
> down further.
>
> Dennis
>
>
> elangovan anbalahan wrote:
>
>> Hello,
>>
>> I am facing a problem with my Nutch search. when i am searching for
>> something in the crawlled pages, i am getting '0' results, This is the
>> case
>> when i am running search on Fedora.
>>
>> But when i do search on same crawlled pages from vista (Using cygwin)
>> everything is proper, and the results are correct.
>>
>> Please help me out with this problem, i have been bangin my head on this
>> one
>> for last one day but no success.
>>
>>
>> Thanks,
>> Elan
>>
>>

Re: Problem with Nutch search

Posted by Dennis Kubes <ku...@apache.org>.
If it is working on windows and not linux my guess is that it is either 
a classpath or a relative path issue.  Here is how I would troubleshoot:

1) Check where searcher.dir is pointing to, make sure that is a fully 
qualified path.  If running distributed search it should point to a 
folder containing a search-servers.xml file, otherwise should point to 
an indexes parent location.
2) Make sure any uppercase / lowercase differences are resolved.
3) Make sure you are pointing to the parent of the indexes directory. 
That parent should contain a segments folder, an indexes folder, and 
possibly a linkdb folder.
4) Make sure plugins folder exist.
5) Make sure you are using the same version of Nutch and Hadoop and the 
plugins for both indexing and serving.
6) Make sure you are using the same java version for indexing and serving.
7) Try using NutchBean to do a search and see if results are returned.
8) Try doing a search that should return anything, like "http".
9) Set log4j.properties logging to all and check logs for any errors.
10) Did all that and still not seeing anything, try changing the version 
of the servlet container you are using (I have seen problems with some 
intermediate builds of tomcat).

Still need more help.  Give more info and we might be able to narrow it 
down further.

Dennis

elangovan anbalahan wrote:
> Hello,
> 
> I am facing a problem with my Nutch search. when i am searching for
> something in the crawlled pages, i am getting '0' results, This is the case
> when i am running search on Fedora.
> 
> But when i do search on same crawlled pages from vista (Using cygwin)
> everything is proper, and the results are correct.
> 
> Please help me out with this problem, i have been bangin my head on this one
> for last one day but no success.
> 
> 
> Thanks,
> Elan
>