[jira] [Commented] (NUTCH-1448) Redirected urls should be handled more cleanly (more like an outlink url)

["Ferdy Galema (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/NUTCH-1448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13446515#comment-13446515 ] 

Ferdy Galema commented on NUTCH-1448:
-------------------------------------

Yes it does show up as an outlink.

About your issue 1461: That is a duplicate indeed. It fixes the problem when it already is corrupt, but this issue is for preventing it from happening in the first place. I think 1461 should be closed in favor to this one. (But it is a nice workaround for present corrupt databases).
                
> Redirected urls should be handled more cleanly (more like an outlink url)
> -------------------------------------------------------------------------
>
>                 Key: NUTCH-1448
>                 URL: https://issues.apache.org/jira/browse/NUTCH-1448
>             Project: Nutch
>          Issue Type: Improvement
>            Reporter: Ferdy Galema
>             Fix For: 2.1
>
>         Attachments: nutch-1448.txt
>
>
> This is specifically for Nutch2.x. Handling a redirects url like an outlink is much more cleaner because this makes it more simple to trace how new urls are added to the webpage database. Instant fetching of redirects won't work, but this is a small price to pay. (Note that this currently does not work at all, because the http.max.redirect property has no effect). Will be attaching a patch in the upcoming days.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira