You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@nutch.apache.org by "Julien Nioche (JIRA)" <ji...@apache.org> on 2014/06/26 14:45:26 UTC

[jira] [Created] (NUTCH-1806) Delegate processing of URL domains to crawler commons

Julien Nioche created NUTCH-1806:
------------------------------------

             Summary: Delegate processing of URL domains to crawler commons
                 Key: NUTCH-1806
                 URL: https://issues.apache.org/jira/browse/NUTCH-1806
             Project: Nutch
          Issue Type: Improvement
    Affects Versions: 1.8
            Reporter: Julien Nioche


We have code in src/java/org/apache/nutch/util/domain and a resource file conf/domain-suffixes.xml to handle URL domains. This is used mostly from URLUtil.getDomainName.

The resource file is not necessarily up to date and since crawler commons has a similar functionality we should use it instead of having to maintain our own resources.



--
This message was sent by Atlassian JIRA
(v6.2#6252)