You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@nutch.apache.org by Nayanish Hinge <na...@gmail.com> on 2010/09/02 11:25:51 UTC

Nutch crawl failure

Hi,
I have a doubt, not sure if anybody has already thought about it
What if nutch crawler fails during its crawling cycles, could we restart the
crawling right from where we left?
I mean, starting with only the unfetched urls.

Thanks
-- 
Nayanish
Hyderabad

Re: Nutch crawl failure

Posted by Markus Jelsma <ma...@buyways.nl>.

http://wiki.apache.org/nutch/FAQ#How_can_I_recover_an_aborted_fetch_process.3F

On Thursday 02 September 2010 11:25:51 Nayanish Hinge wrote:
> Hi,
> I have a doubt, not sure if anybody has already thought about it
> What if nutch crawler fails during its crawling cycles, could we restart
>  the crawling right from where we left?
> I mean, starting with only the unfetched urls.
> 
> Thanks
> 

Markus Jelsma - Technisch Architect - Buyways BV
http://www.linkedin.com/in/markus17
050-8536620 / 06-50258350