You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@nutch.apache.org by "Lewis John McGibbney (Jira)" <ji...@apache.org> on 2024/04/20 01:29:00 UTC
[jira] [Created] (NUTCH-3041) Address confusing logging in o.a.n.net.URLExemptionFilters
Lewis John McGibbney created NUTCH-3041:
-------------------------------------------
Summary: Address confusing logging in o.a.n.net.URLExemptionFilters
Key: NUTCH-3041
URL: https://issues.apache.org/jira/browse/NUTCH-3041
Project: Nutch
Issue Type: Task
Components: net
Affects Versions: 1.19, 1.20
Reporter: Lewis John McGibbney
Assignee: Lewis John McGibbney
Fix For: 1.21
URLExemptionFilter impementations are used to allow exemptions to external domain resources by overriding the {{db.ignore.external.links}} configuration setting. This is useful when the crawl is focused to a domain but resources like images are hosted on CDN.
Currently [URLExemptionFilters|[https://github.com/apache/nutch/blob/271f92e11c39b7a3583cfcd8d664262cfac59674/src/java/org/apache/nutch/net/URLExemptionFilters.java#L47-L48]] provides some confusing INFO-level logging
{quote}INFO o.a.n.n.URLExemptionFilters [LocalJobRunner Map Task Executor #0] Found 0 extensions at point:'org.apache.nutch.net.URLExemptionFilter'
{quote}
I find this confusing. It would be better to log *only* if an URLExemptionFilter implementation actually exists for a given URL.
I will provide a patch for this.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)