You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@nutch.apache.org by Suraj Singh <ss...@olbico.nl> on 2018/12/18 16:01:57 UTC

Unfetched URLs after TIME_LIMIT_FETCH

Hello,

I want to understand what happens to the URLs which remains Unfetched due to fetch time limit.
Are they fetched in the subsequent rounds?

Thanks in advance.

Regards,
Suraj Singh

RE: Unfetched URLs after TIME_LIMIT_FETCH

Posted by Suraj Singh <ss...@olbico.nl>.

Thanks Sebastian.

Regards,
Suraj Singh

-----Original Message-----
From: Sebastian Nagel <wa...@googlemail.com.INVALID> 
Sent: Tuesday, 18 December 2018 17:28
To: user@nutch.apache.org
Subject: Re: Unfetched URLs after TIME_LIMIT_FETCH

Yes. They don't get updated and stay in status db_unfetched and will be generated in the next cycle again.

On 12/18/18 5:01 PM, Suraj Singh wrote:
> Hello,
> 
> I want to understand what happens to the URLs which remains Unfetched due to fetch time limit.
> Are they fetched in the subsequent rounds?
> 
> Thanks in advance.
> 
> Regards,
> Suraj Singh
>

Re: Unfetched URLs after TIME_LIMIT_FETCH

Posted by Sebastian Nagel <wa...@googlemail.com.INVALID>.

Yes. They don't get updated and stay in status db_unfetched
and will be generated in the next cycle again.

On 12/18/18 5:01 PM, Suraj Singh wrote:
> Hello,
> 
> I want to understand what happens to the URLs which remains Unfetched due to fetch time limit.
> Are they fetched in the subsequent rounds?
> 
> Thanks in advance.
> 
> Regards,
> Suraj Singh
>