You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@nutch.apache.org by "Chris A. Mattmann (JIRA)" <ji...@apache.org> on 2015/02/26 05:05:05 UTC
[jira] [Commented] (NUTCH-1870) Generic xsl parser plugin
[ https://issues.apache.org/jira/browse/NUTCH-1870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14337839#comment-14337839 ]
Chris A. Mattmann commented on NUTCH-1870:
------------------------------------------
Hi Seb:
bq. ev. we should simplify how the parsers are called in AbstractCrawlTest: just call ParseUtil.parse(). This would also make the parse-xsl tests sensitive to changes in parse-html (or parse-tika).
Totally agree! I remember whipping up ParseUtil a long time ago and I think it's still a good place to encapsulate calls to parsers.
> Generic xsl parser plugin
> -------------------------
>
> Key: NUTCH-1870
> URL: https://issues.apache.org/jira/browse/NUTCH-1870
> Project: Nutch
> Issue Type: New Feature
> Components: indexer, parser
> Affects Versions: 1.9
> Reporter: Albinscode
> Fix For: 1.11
>
> Attachments: NUTCH-1870-trunk-v3.patch, NUTCH-1870-trunk-v4.patch, nutch-site.xml, xsl-parse-plugin.patch, xsl-parse-plugin2.patch
>
>
> The aim of this plugin is to use XSLT to extract metadata from HTML DOM structures.
> | Your Data | --> | Parse-html plugin or TIKA plugin | --> | DOM structure | --> |XSLT plugin |
>
>
> The main advantage is that:
> - You won't have to produce any java code, only XSLT and configuration
> - It can process DOM structure from DocumentFragment (@see NekoHtml and @see TagSoup)
> - It is HtmlParseFilter plugin compatible and can be plugged as any other plugin (parse-js, parse-swf, etc...)
> This topic has been discussed on http://www.mail-archive.com/dev%40nutch.apache.org/msg15257.html
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)