You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@nutch.apache.org by "ASF GitHub Bot (JIRA)" <ji...@apache.org> on 2015/05/01 00:42:06 UTC
[jira] [Commented] (NUTCH-2004) ParseChecker does not handle
redirects
[ https://issues.apache.org/jira/browse/NUTCH-2004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14522414#comment-14522414 ]
ASF GitHub Bot commented on NUTCH-2004:
---------------------------------------
GitHub user MJJoyce opened a pull request:
https://github.com/apache/nutch/pull/23
NUTCH-2004: Update parsechecker to handle redirects
- Parsechecker now handles redirects if the configuration has a value
greater than 0 set for http.redirect.max.
- Add minor convenience function to ProtocolStatus for checking if a
particular status is a redirect.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/MJJoyce/nutch NUTCH-2004
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/nutch/pull/23.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #23
----
commit 2b1188365ffba290c5cbf128bad98d1ed6eb00c2
Author: Michael Joyce <ml...@gmail.com>
Date: 2015-04-30T22:26:38Z
NUTCH-2004: Update parsechecker to handle redirects
- Parsechecker now handles redirects if the configuration has a value
greater than 0 set for http.redirect.max.
- Add minor convenience function to ProtocolStatus for checking if a
particular status is a redirect.
----
> ParseChecker does not handle redirects
> --------------------------------------
>
> Key: NUTCH-2004
> URL: https://issues.apache.org/jira/browse/NUTCH-2004
> Project: Nutch
> Issue Type: Improvement
> Affects Versions: 1.9
> Reporter: Michael Joyce
> Priority: Minor
>
> At the moment ParseChecker doesn't handle redirects. If it gets anything but a success status it errors out. It would be nice if it handled redirects a bit more gracefully based on the http.redirects config setting.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)