You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@nutch.apache.org by "Lewis John McGibbney (JIRA)" <ji...@apache.org> on 2014/10/23 22:27:34 UTC
[jira] [Comment Edited] (NUTCH-1644) Should have a parser that uses
xpath
[ https://issues.apache.org/jira/browse/NUTCH-1644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14181899#comment-14181899 ]
Lewis John McGibbney edited comment on NUTCH-1644 at 10/23/14 8:26 PM:
-----------------------------------------------------------------------
bq. extract embedded content (single elements, attributes) from DOM tree, or
AFAIK, this is the aim here.
With work we have done over the summer, we noticed two things
* sometimes people want easily configurable (dare I say it) scraping capabilities
* if they cannot get that, then not only do they use a different piece of software (scrapy) they are also prepared to use an entirely different language (Python) in order to achieve the task at hand.
.. an XPath plugin is a huge step towards addressing both of the above and it is important that we make the functionality available for users.
was (Author: lewismc):
bq. extract embedded content (single elements, attributes) from DOM tree, or
AFAIK, this is the aim here.
With work we have done over the summer, we noticed two things
* sometimes people want easily configurable (dare I say it) scraping capabilities
* if they cannot get that, then not only do they use a different piece of software (scrapy) they are also prepared to use an entirely different language (Python) in order to achieve the task at hand.
.. an XPath plugin is a huge step towards addressing both of the above and it is important that we make the functionality available for users.
> Should have a parser that uses xpath
> ------------------------------------
>
> Key: NUTCH-1644
> URL: https://issues.apache.org/jira/browse/NUTCH-1644
> Project: Nutch
> Issue Type: New Feature
> Components: parser
> Affects Versions: 2.2.1
> Reporter: cihad güzel
> Assignee: Lewis John McGibbney
> Labels: parser, xpath
> Fix For: 2.3
>
> Attachments: NUTCH-1644.patch
>
>
> May want to parse some url via xpath. May be blog or news web sites. Should be a plugin using xpath parse.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)