You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@nutch.apache.org by "Markus Jelsma (JIRA)" <ji...@apache.org> on 2014/06/17 10:23:03 UTC
[jira] [Commented] (NUTCH-1793) HttpRobotRulesParser not configured
properly => "http.robots.403.allow" property is not read
[ https://issues.apache.org/jira/browse/NUTCH-1793?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14033548#comment-14033548 ]
Markus Jelsma commented on NUTCH-1793:
--------------------------------------
+1, thanks!
> HttpRobotRulesParser not configured properly => "http.robots.403.allow" property is not read
> --------------------------------------------------------------------------------------------
>
> Key: NUTCH-1793
> URL: https://issues.apache.org/jira/browse/NUTCH-1793
> Project: Nutch
> Issue Type: Bug
> Components: protocol
> Affects Versions: 1.8
> Reporter: Julien Nioche
> Attachments: NUTCH-1793.patch
>
>
> HttpRobotRulesParser is instanciated by HttpBase with an empty constructor and the conf() method is called later but relies on the super implementation and as a result the "http.robots.403.allow" property is not read.
> Am OK to leave this property in HttpRobotRulesParser but it should override setConf so that the property is initialised properly.
--
This message was sent by Atlassian JIRA
(v6.2#6252)