You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@nutch.apache.org by Eyeris Rodriguez Rueda <er...@uci.cu> on 2012/11/23 03:23:11 UTC
doubts about some propierties on nutch-site.xml file
Hi all.
I have some doubts about some properties on nutch-site.xml file, i will appreciated if anybody can explain me about it function in detail.
Im using nutch 1.5.1 and solr 3.6.
First
<property>
<name>db.fetch.schedule.adaptive.inc_rate</name>
<value>0.4</value>
<description>If a page is unmodified, its fetchInterval will be
increased by this rate. This value should not
exceed 0.5, otherwise the algorithm becomes unstable.</description>
</property>
In this case how the fetchInterval is modified by this value what means that ??
*********************************************************************************
Second
<property>
<name>db.fetch.schedule.adaptive.sync_delta</name>
<value>true</value>
<description>If true, try to synchronize with the time of page change.
by shifting the next fetchTime by a fraction (sync_rate) of the difference
between the last modification time, and the last fetch time.</description>
</property>
I can´t understand this propierty.
******************************************
regards.
10mo. ANIVERSARIO DE LA CREACION DE LA UNIVERSIDAD DE LAS CIENCIAS INFORMATICAS...
CONECTADOS AL FUTURO, CONECTADOS A LA REVOLUCION
http://www.uci.cu
http://www.facebook.com/universidad.uci
http://www.flickr.com/photos/universidad_uci
Re: doubts about some propierties on nutch-site.xml file
Posted by Lewis John Mcgibbney <le...@gmail.com>.
Lovely Javadoc Andrzej
On Fri, Nov 23, 2012 at 7:32 AM, Markus Jelsma
<ma...@openindex.io> wrote:
> See: http://nutch.apache.org/apidocs-2.1/org/apache/nutch/crawl/AdaptiveFetchSchedule.html
>
>
>
> -----Original message-----
>> From:Eyeris Rodriguez Rueda <er...@uci.cu>
>> Sent: Fri 23-Nov-2012 03:29
>> To: user@nutch.apache.org
>> Subject: doubts about some propierties on nutch-site.xml file
>>
>> Hi all.
>>
>> I have some doubts about some properties on nutch-site.xml file, i will appreciated if anybody can explain me about it function in detail.
>>
>> Im using nutch 1.5.1 and solr 3.6.
>>
>> First
>> <property>
>> <name>db.fetch.schedule.adaptive.inc_rate</name>
>> <value>0.4</value>
>> <description>If a page is unmodified, its fetchInterval will be
>> increased by this rate. This value should not
>> exceed 0.5, otherwise the algorithm becomes unstable.</description>
>> </property>
>>
>> In this case how the fetchInterval is modified by this value what means that ??
>> *********************************************************************************
>> Second
>> <property>
>> <name>db.fetch.schedule.adaptive.sync_delta</name>
>> <value>true</value>
>> <description>If true, try to synchronize with the time of page change.
>> by shifting the next fetchTime by a fraction (sync_rate) of the difference
>> between the last modification time, and the last fetch time.</description>
>> </property>
>> I can´t understand this propierty.
>> ******************************************
>> regards.
>>
>> 10mo. ANIVERSARIO DE LA CREACION DE LA UNIVERSIDAD DE LAS CIENCIAS INFORMATICAS...
>> CONECTADOS AL FUTURO, CONECTADOS A LA REVOLUCION
>>
>> http://www.uci.cu
>> http://www.facebook.com/universidad.uci
>> http://www.flickr.com/photos/universidad_uci
>>
--
Lewis
RE: doubts about some propierties on nutch-site.xml file
Posted by Markus Jelsma <ma...@openindex.io>.
See: http://nutch.apache.org/apidocs-2.1/org/apache/nutch/crawl/AdaptiveFetchSchedule.html
-----Original message-----
> From:Eyeris Rodriguez Rueda <er...@uci.cu>
> Sent: Fri 23-Nov-2012 03:29
> To: user@nutch.apache.org
> Subject: doubts about some propierties on nutch-site.xml file
>
> Hi all.
>
> I have some doubts about some properties on nutch-site.xml file, i will appreciated if anybody can explain me about it function in detail.
>
> Im using nutch 1.5.1 and solr 3.6.
>
> First
> <property>
> <name>db.fetch.schedule.adaptive.inc_rate</name>
> <value>0.4</value>
> <description>If a page is unmodified, its fetchInterval will be
> increased by this rate. This value should not
> exceed 0.5, otherwise the algorithm becomes unstable.</description>
> </property>
>
> In this case how the fetchInterval is modified by this value what means that ??
> *********************************************************************************
> Second
> <property>
> <name>db.fetch.schedule.adaptive.sync_delta</name>
> <value>true</value>
> <description>If true, try to synchronize with the time of page change.
> by shifting the next fetchTime by a fraction (sync_rate) of the difference
> between the last modification time, and the last fetch time.</description>
> </property>
> I can´t understand this propierty.
> ******************************************
> regards.
>
> 10mo. ANIVERSARIO DE LA CREACION DE LA UNIVERSIDAD DE LAS CIENCIAS INFORMATICAS...
> CONECTADOS AL FUTURO, CONECTADOS A LA REVOLUCION
>
> http://www.uci.cu
> http://www.facebook.com/universidad.uci
> http://www.flickr.com/photos/universidad_uci
>