You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@nutch.apache.org by Kumar Limbu <ku...@gmail.com> on 2005/12/05 05:38:58 UTC

Hi how can I do a incremental crawling

Hi,

I am trying to  create a site which will crawl a handful no. of sites. I am
using whole-web crawling to crawl these sites. The problem is I am don't
know how to do a incremental crawling, i.e. only fetch and update, the
webpages which has changed since last crawled.

Thank you all.

--
Keep on smiling :)
Kumar