You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@nutch.apache.org by "Greg Padiasek (JIRA)" <ji...@apache.org> on 2014/04/06 06:05:14 UTC

[jira] [Created] (NUTCH-1749) Title duplicated in document body

Greg Padiasek created NUTCH-1749:
------------------------------------

             Summary: Title duplicated in document body
                 Key: NUTCH-1749
                 URL: https://issues.apache.org/jira/browse/NUTCH-1749
             Project: Nutch
          Issue Type: Bug
          Components: parser
    Affects Versions: 1.7
            Reporter: Greg Padiasek


The HTML parser plugin inserts document title into document content. Since the title alone can be retrieved via DOMContentUtils.getTitle() and content is retrieved via DOMContentUtils.getText(), there is no need to duplicate title in the content. When title is included in the content it becomes difficult/impossible to extract document body without title. A need to extract document body without title is visible when user wants to index or display body and title separately.

Attached is a patch which prevents including title in document content in the HTML parser plugin.



--
This message was sent by Atlassian JIRA
(v6.2#6252)