[jira] [Resolved] (NUTCH-2868) urlnormalizer-protocol fails with StringIndexOutOfBoundsException when reading invalid line in configuration file

["Sebastian Nagel (Jira)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/NUTCH-2868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Sebastian Nagel resolved NUTCH-2868.
------------------------------------
    Resolution: Fixed

> urlnormalizer-protocol fails with StringIndexOutOfBoundsException when reading invalid line in configuration file
> -----------------------------------------------------------------------------------------------------------------
>
>                 Key: NUTCH-2868
>                 URL: https://issues.apache.org/jira/browse/NUTCH-2868
>             Project: Nutch
>          Issue Type: Bug
>          Components: plugin, urlnormalizer
>    Affects Versions: 1.18
>            Reporter: Sebastian Nagel
>            Assignee: Sebastian Nagel
>            Priority: Minor
>             Fix For: 1.19
>
>
> When reading a invalid line in the configuration file, the protocol urlnormalizer may fail with a StringIndexOutOfBoundsException:
> {noformat}
> 2021-06-10 05:10:41,877 WARN [main] org.apache.hadoop.mapred.YarnChild: Exception running child : java.lang.StringIndexOutOfBoundsException: String index out of range: -1
>         at java.lang.String.substring(String.java:1967)
>         at org.apache.nutch.net.urlnormalizer.protocol.ProtocolURLNormalizer.readConfiguration(ProtocolURLNormalizer.java:95)
>         at org.apache.nutch.net.urlnormalizer.protocol.ProtocolURLNormalizer.setConf(ProtocolURLNormalizer.java:182)
> {noformat}
> The invalid line should be logged and skipped without causing the job to fail.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)