You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@nutch.apache.org by "K.A.Hussain Ali" <Hu...@photoninfotech.com> on 2005/12/07 07:53:55 UTC
searching while crawling.
HI all,
while crawling using Nutch could we make out a search over the segments crawled and indexed.
i had some error while doing the above way , i dont get any hits,
kindly send me ur suggestion to overcome the above,and also
should we do search only after the whole crawling ends ?
Thanks in advance
regards
-Hussain
Re :Re: searching while crawling.
Posted by "K.A.Hussain Ali" <Hu...@photoninfotech.com>.
Hi all
Thanks stefan for the reply
.. but i did as you mentioned like...
generate ,fetch ,update and index cycles but the Nutch doesnt search the New
segment indexed unless i do restart the server.
Any suggestions would be greatly helpful.
Thanks in advance
regards
-Hussain.
----- Original Message -----
From: "Stefan Groschupf" <sg...@media-style.com>
To: <nu...@lucene.apache.org>
Sent: Thursday, December 08, 2005 1:40 AM
Subject: Re: searching while crawling.
> Hi.
> you do the generate, fetch, update, index cycle and than you can add
> this segment to be searched.
> I prefer to have a ready folder and a working folder and in case a
> segemtn is ready indexed my shell script just move it to ready.
> After 30 days I delete the segment to start from beginning.
> HTH
> Stefan
>
> Am 07.12.2005 um 07:53 schrieb K.A.Hussain Ali:
>
>>
>> HI all,
>>
>> while crawling using Nutch could we make out a search over the
>> segments crawled and indexed.
>> i had some error while doing the above way , i dont get any hits,
>> kindly send me ur suggestion to overcome the above,and also
>> should we do search only after the whole crawling ends ?
>>
>> Thanks in advance
>> regards
>> -Hussain
>
> ---------------------------------------------------------------
> company: http://www.media-style.com
> forum: http://www.text-mining.org
> blog: http://www.find23.net
>
>
>
Re: searching while crawling.
Posted by Stefan Groschupf <sg...@media-style.com>.
Hi.
you do the generate, fetch, update, index cycle and than you can add
this segment to be searched.
I prefer to have a ready folder and a working folder and in case a
segemtn is ready indexed my shell script just move it to ready.
After 30 days I delete the segment to start from beginning.
HTH
Stefan
Am 07.12.2005 um 07:53 schrieb K.A.Hussain Ali:
>
> HI all,
>
> while crawling using Nutch could we make out a search over the
> segments crawled and indexed.
> i had some error while doing the above way , i dont get any hits,
> kindly send me ur suggestion to overcome the above,and also
> should we do search only after the whole crawling ends ?
>
> Thanks in advance
> regards
> -Hussain
---------------------------------------------------------------
company: http://www.media-style.com
forum: http://www.text-mining.org
blog: http://www.find23.net