You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@nutch.apache.org by Diane Palla <pa...@shu.edu> on 2005/08/30 20:26:03 UTC

Incremental crawling available?

Dear anyone who knows,

Is there a way to perform an incremental crawl?  What I mean is crawl only 
the pages that have changed since the last crawl that was done.  If so, 
how long does this typically take per web page or per size of files?

Diane Palla
Web Services Developer
Seton Hall University
973 313-6199
palladia@shu.edu