You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@nutch.apache.org by "Lewis John McGibbney (JIRA)" <ji...@apache.org> on 2013/06/19 05:27:19 UTC

[jira] [Created] (NUTCH-1585) Ensure duplicate tags do not exist in microformat-reltag tag set.

Lewis John McGibbney created NUTCH-1585:
-------------------------------------------

             Summary: Ensure duplicate tags do not exist in microformat-reltag tag set.
                 Key: NUTCH-1585
                 URL: https://issues.apache.org/jira/browse/NUTCH-1585
             Project: Nutch
          Issue Type: Improvement
          Components: parser
    Affects Versions: 2.2, 1.6
            Reporter: Lewis John McGibbney
             Fix For: 2.3, 1.8


A WebPage can have many many embedded tags and other such markup.
Creating huge tag lists containing many many duplicates is counter productive to the process of parsing and extracting out such structure.
We should add a mechanism to only include single tag occurrences for the microformats-reltag parser.  

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira