You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@nutch.apache.org by "Sebastian Nagel (JIRA)" <ji...@apache.org> on 2013/09/08 22:49:51 UTC

[jira] [Commented] (NUTCH-1636) Indexer to normalize and filter repr URL

    [ https://issues.apache.org/jira/browse/NUTCH-1636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13761525#comment-13761525 ] 

Sebastian Nagel commented on NUTCH-1636:
----------------------------------------

Reported by Iain Lopata [[1|http://mail-archives.apache.org/mod_mbox/nutch-user/201309.mbox/%3CSNT149-DS13EBCF60B4E83801BB5753903C0@phx.gbl%3E]].
                
> Indexer to normalize and filter repr URL
> ----------------------------------------
>
>                 Key: NUTCH-1636
>                 URL: https://issues.apache.org/jira/browse/NUTCH-1636
>             Project: Nutch
>          Issue Type: Bug
>          Components: indexer
>    Affects Versions: 1.6, 1.7
>            Reporter: Sebastian Nagel
>            Priority: Minor
>             Fix For: 1.8
>
>         Attachments: NUTCH-1636-1.patch
>
>
> Indexer if used with option -normalize and/or -filter (cf. NUTCH-1300) should also normalize and filter representation URLs. Otherwise URLs which are target of a redirect, and have repr URL set (see URLUtil.chooseRepr) may show up in index with an undesirable URL.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira