You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@nutch.apache.org by Arun Kaundal <ar...@gmail.com> on 2005/12/21 14:16:57 UTC
Re: Problem re-running crawl tool ? Is there any way to run nutch crawl tool any number of times
I don't think it is correct solution of my problem . Please read it
carefully.
On 12/21/05, Stefan Groschupf <sg...@media-style.com> wrote:
>
> Please user the user list and do not write me directly. Thanks!
> This document will help you:
> http://wiki.apache.org/nutch/SimpleMapReduceTutorial
>
> Am 21.12.2005 um 12:57 schrieb Arun Kumar Sharma:
>
> > Hi Stefan,
> > There is problem re-running crawl tool ? Is there any way to run
> > nutch crawl tool any number of times .
> > my requirement is to run it as many number as require. Is it
> > correct way , if I comment check for directory existence and make
> > some modification in crawl tool to make it run any number of times.
> > Is it design for that? If so where exactly the modification
> > required???
> >
> > waiting your answer anxiouly ....
> >
> >
> > Regards,
> >
> > Arun Kumar Sharma (Tech Lead -Java/J2EE)
> > Mob: +91.981.529.5761
> > Send instant messages to your online friends http://
> > in.messenger.yahoo.com
>
>
>
Re: Problem re-running crawl tool ? Is there any way to run nutch crawl tool any number of times
Posted by Arun Kaundal <ar...@gmail.com>.
I am runing nutch tools in windows environment and when I am it
simultaneously for number of users I am getting so many error likes this
folder already exist . segment.unsorted already exists .. Impossible
condition webdb.new and webdb.old can not exist simultaneously..
On 12/21/05, Stefan Groschupf <sg...@media-style.com> wrote:
>
> if you run the cycle manually may using a shell scrip you can run a
> crawl what just a bundle of steps like generating, fetching update
> and index in never ending loop - as we do.
>
> Am 21.12.2005 um 14:16 schrieb Arun Kaundal:
>
> > I don't think it is correct solution of my problem . Please read it
> > carefully.
> >
> > On 12/21/05, Stefan Groschupf <sg...@media-style.com> wrote:
> >>
> >> Please user the user list and do not write me directly. Thanks!
> >> This document will help you:
> >> http://wiki.apache.org/nutch/SimpleMapReduceTutorial
> >>
> >> Am 21.12.2005 um 12:57 schrieb Arun Kumar Sharma:
> >>
> >>> Hi Stefan,
> >>> There is problem re-running crawl tool ? Is there any way to run
> >>> nutch crawl tool any number of times .
> >>> my requirement is to run it as many number as require. Is it
> >>> correct way , if I comment check for directory existence and make
> >>> some modification in crawl tool to make it run any number of times.
> >>> Is it design for that? If so where exactly the modification
> >>> required???
> >>>
> >>> waiting your answer anxiouly ....
> >>>
> >>>
> >>> Regards,
> >>>
> >>> Arun Kumar Sharma (Tech Lead -Java/J2EE)
> >>> Mob: +91.981.529.5761
> >>> Send instant messages to your online friends http://
> >>> in.messenger.yahoo.com
> >>
> >>
> >>
>
>
Re: Problem re-running crawl tool ? Is there any way to run nutch crawl tool any number of times
Posted by Stefan Groschupf <sg...@media-style.com>.
if you run the cycle manually may using a shell scrip you can run a
crawl what just a bundle of steps like generating, fetching update
and index in never ending loop - as we do.
Am 21.12.2005 um 14:16 schrieb Arun Kaundal:
> I don't think it is correct solution of my problem . Please read it
> carefully.
>
> On 12/21/05, Stefan Groschupf <sg...@media-style.com> wrote:
>>
>> Please user the user list and do not write me directly. Thanks!
>> This document will help you:
>> http://wiki.apache.org/nutch/SimpleMapReduceTutorial
>>
>> Am 21.12.2005 um 12:57 schrieb Arun Kumar Sharma:
>>
>>> Hi Stefan,
>>> There is problem re-running crawl tool ? Is there any way to run
>>> nutch crawl tool any number of times .
>>> my requirement is to run it as many number as require. Is it
>>> correct way , if I comment check for directory existence and make
>>> some modification in crawl tool to make it run any number of times.
>>> Is it design for that? If so where exactly the modification
>>> required???
>>>
>>> waiting your answer anxiouly ....
>>>
>>>
>>> Regards,
>>>
>>> Arun Kumar Sharma (Tech Lead -Java/J2EE)
>>> Mob: +91.981.529.5761
>>> Send instant messages to your online friends http://
>>> in.messenger.yahoo.com
>>
>>
>>