You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@nutch.apache.org by "Sebastian Nagel (Jira)" <ji...@apache.org> on 2024/04/25 15:29:00 UTC
[jira] [Created] (NUTCH-3044) Generator: NPE when extracting the host part of a URL fails
Sebastian Nagel created NUTCH-3044:
--------------------------------------
Summary: Generator: NPE when extracting the host part of a URL fails
Key: NUTCH-3044
URL: https://issues.apache.org/jira/browse/NUTCH-3044
Project: Nutch
Issue Type: Bug
Components: generator
Affects Versions: 1.20
Reporter: Sebastian Nagel
Fix For: 1.21
When extracting the host part of a URL fails, the Generator job fails because of a NPE in the SelectorReducer. This issue is reproducible if the CrawlDb contains an malformed URL, for example, a URL with an unsupported scheme (smb://).
{noformat}
Caused by: java.lang.NullPointerException
at org.apache.nutch.crawl.Generator$SelectorReducer.reduce(Generator.java:439)
at org.apache.nutch.crawl.Generator$SelectorReducer.reduce(Generator.java:300)
{noformat}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)