[jira] [Updated] (NUTCH-710) Support for rel="canonical" attribute

["Sertac TURKEL (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/NUTCH-710?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Sertac TURKEL updated NUTCH-710:
--------------------------------

    Attachment: NUTCH-710.patch

Hi [~lewismc] ,

I prepared a patch file to solve this issue for 2.x branch. Patch file also covers test cases for tika parser and html parser plugins.Could you review my patch files.

> Support for rel="canonical" attribute
> -------------------------------------
>
>                 Key: NUTCH-710
>                 URL: https://issues.apache.org/jira/browse/NUTCH-710
>             Project: Nutch
>          Issue Type: New Feature
>    Affects Versions: 1.1
>            Reporter: Frank McCown
>            Priority: Minor
>             Fix For: 1.9
>
>         Attachments: NUTCH-710.patch, canonical.patch
>
>
> There is a the new rel="canonical" attribute which is
> now being supported by Google, Yahoo, and Live:
> http://googlewebmastercentral.blogspot.com/2009/02/specify-your-canonical.html
> Adding support for this attribute value will potentially reduce the number of URLs crawled and indexed and reduce duplicate page content.



--
This message was sent by Atlassian JIRA
(v6.2#6252)