You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@nutch.apache.org by "Julien Nioche (JIRA)" <ji...@apache.org> on 2014/11/05 16:51:33 UTC

[jira] [Updated] (NUTCH-1887) Specify HTMLMapper to use in TikaParser

     [ https://issues.apache.org/jira/browse/NUTCH-1887?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Julien Nioche updated NUTCH-1887:
---------------------------------
    Description: 
The TikaParser currently relies on the default HTMLMapper used by Tika. The HTMLMapper is used in Tika to filter / normalise the HTML elements passed as SAX events. By default it uses a DefaultHtmlMapper which removes some of the input.

This patch allows to specify which HTMLMapper implementation to use (if any).

  was:
The TikaParser currently relies on the default HTMLMapper used by Tika. The HTMLMapper is used in Tika to filter / normalise the HTML elements passed as SAX events. By default it uses a DefaultHtmlMapper which removes some of the input.

This patch allows to specify which HTMLMapper implementation to use (if any) and defaults to the IdentityHtmlMapper used in Tika via the nutch-default.xml.


> Specify HTMLMapper to use in TikaParser
> ---------------------------------------
>
>                 Key: NUTCH-1887
>                 URL: https://issues.apache.org/jira/browse/NUTCH-1887
>             Project: Nutch
>          Issue Type: Improvement
>          Components: parser
>    Affects Versions: 1.9
>            Reporter: Julien Nioche
>            Priority: Minor
>             Fix For: 1.10
>
>
> The TikaParser currently relies on the default HTMLMapper used by Tika. The HTMLMapper is used in Tika to filter / normalise the HTML elements passed as SAX events. By default it uses a DefaultHtmlMapper which removes some of the input.
> This patch allows to specify which HTMLMapper implementation to use (if any).



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)