You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@nutch.apache.org by "Chris A. Mattmann (JIRA)" <ji...@apache.org> on 2015/02/26 05:05:05 UTC

[jira] [Commented] (NUTCH-1870) Generic xsl parser plugin

    [ https://issues.apache.org/jira/browse/NUTCH-1870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14337839#comment-14337839 ] 

Chris A. Mattmann commented on NUTCH-1870:
------------------------------------------

Hi Seb:

bq. ev. we should simplify how the parsers are called in AbstractCrawlTest: just call ParseUtil.parse(). This would also make the parse-xsl tests sensitive to changes in parse-html (or parse-tika).

Totally agree! I remember whipping up ParseUtil a long time ago and I think it's still a good place to encapsulate calls to parsers.

> Generic xsl parser plugin
> -------------------------
>
>                 Key: NUTCH-1870
>                 URL: https://issues.apache.org/jira/browse/NUTCH-1870
>             Project: Nutch
>          Issue Type: New Feature
>          Components: indexer, parser
>    Affects Versions: 1.9
>            Reporter: Albinscode
>             Fix For: 1.11
>
>         Attachments: NUTCH-1870-trunk-v3.patch, NUTCH-1870-trunk-v4.patch, nutch-site.xml, xsl-parse-plugin.patch, xsl-parse-plugin2.patch
>
>
> The aim of this plugin is to use XSLT to extract metadata from HTML DOM structures.
> | Your Data | --> | Parse-html plugin  or TIKA plugin | --> | DOM structure | --> |XSLT plugin |
>                   
>                   
> The main advantage is that:
> - You won't have to produce any java code, only XSLT and configuration
> - It can process DOM structure from DocumentFragment (@see NekoHtml and @see TagSoup)
> - It is HtmlParseFilter plugin compatible and can be plugged as any other plugin (parse-js, parse-swf, etc...)
> This topic has been discussed on http://www.mail-archive.com/dev%40nutch.apache.org/msg15257.html



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)