You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@nutch.apache.org by "Markus Jelsma (JIRA)" <ji...@apache.org> on 2011/04/01 17:05:06 UTC
[jira] [Closed] (NUTCH-113) Disable permanent DNS-to-IP caching for
JVM 1.4
[ https://issues.apache.org/jira/browse/NUTCH-113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Markus Jelsma closed NUTCH-113.
-------------------------------
Resolution: Won't Fix
Bulk close of legacy issues:
http://www.lucidimagination.com/search/document/2738eeb014805854/clean_up_open_legacy_issues_in_jira
> Disable permanent DNS-to-IP caching for JVM 1.4
> -----------------------------------------------
>
> Key: NUTCH-113
> URL: https://issues.apache.org/jira/browse/NUTCH-113
> Project: Nutch
> Issue Type: Improvement
> Components: fetcher
> Affects Versions: 0.7.2, 0.8
> Reporter: Fuad Efendi
> Priority: Trivial
>
> DNS-to-IP mapping may change during long crawls, by default JVM 1.4 caches it forever.
> Some related discussions at Jakarta-HttpClient-User
> http://mail-archives.apache.org/mod_mbox/jakarta-httpclient-user/200506.mbox/%3c20050627022440.SVIL13442.lakermmtao05.cox.net@zeus%3e
> http://java.sun.com/j2se/1.4.2/docs/guide/net/properties.html
> networkaddress.cache.ttl (default: -1)
> Specified in java.security to indicate the caching policy for successful name lookups from the name service.. The value is specified as as integer to indicate the number of seconds to cache the successful lookup.
> A value of -1 indicates "cache forever".
> We probably need this code in org.apache.nutch.fetcher.Fetcher:
> private static final int FETCHER_DNS_TTL_MINUTES =
> NutchConf.get().getInt("fetcher.dns.ttl.minutes", 120);
> static {
> java.security.Security.setProperty("networkaddress.cache.ttl", "" + FETCHER_DNS_TTL_MINUTES*60);
> }
> And, new property in nutch-default.xml:
> <property>
> <name>fetcher.dns.ttl.minutes</name>
> <value>120</value>
> <description>DNS-to-IP cache, Time-to-Live</description>
> </property>
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira