You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@nutch.apache.org by Manish Verma <m_...@apple.com> on 2016/02/01 22:10:01 UTC

Crawl Every Page Every Time

Hi,

I want to recrawl  all pages every time I recrawl , irrespective of when the fetched last time ?

Thanks
Manish

RE: Crawl Every Page Every Time

Posted by Markus Jelsma <ma...@openindex.io>.

Hi - you can use a default fetch interval of 1 second. 
Markus 
 
-----Original message-----
> From:Manish Verma <m_...@apple.com>
> Sent: Tuesday 2nd February 2016 3:33
> To: user@nutch.apache.org
> Subject: Crawl Every Page Every Time
> 
> Hi,
> 
> I want to recrawl  all pages every time I recrawl , irrespective of when the fetched last time ?
> 
> Thanks
> Manish 
> 
>