You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@nutch.apache.org by "Julien Nioche (JIRA)" <ji...@apache.org> on 2013/07/02 19:43:21 UTC
[jira] [Commented] (NUTCH-1599) Obtain consensus on new description
of Nutch
[ https://issues.apache.org/jira/browse/NUTCH-1599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13698027#comment-13698027 ]
Julien Nioche commented on NUTCH-1599:
--------------------------------------
I usually describe Nutch as a 'web crawler' instead of 'web-search software project' as the latter dates back from when we used to handle indexing and search within Nutch. We are now focusing purely on the crawling which is a good thing.
Explaining that there are 2 versions and briefly what the differences are is a good idea.
I wouldn't give the document format parsing as an example of what we gain from being modular and pluggable but instead mention that bespoke extractors (ParsingFilters) can be implemented for specific extraction tasks or mention the pluggable indexer.
> Obtain consensus on new description of Nutch
> --------------------------------------------
>
> Key: NUTCH-1599
> URL: https://issues.apache.org/jira/browse/NUTCH-1599
> Project: Nutch
> Issue Type: Improvement
> Components: documentation
> Reporter: Lewis John McGibbney
> Assignee: Lewis John McGibbney
> Fix For: 2.3, 1.8
>
>
> As we seem to be sustaining pushes and maintenance (touch wood) of two branches, I think it is about time we agreed on a more accurate description of what Nutch actually is.
> We currently have (taken directly from our site)
> {code:xml}
> Apache Nutch is an open source web-search software project. Stemming from Apache Lucene, it now builds on Apache Solr adding web-specifics, such as a crawler, a link-graph database and parsing support handled by Apache Tika for HTML and and array other document formats.
> Nutch can run on a single machine, but gains a lot of its strength from running in a Hadoop cluster
> The system can be enhanced (eg other document formats can be parsed) using a highly flexible, easily extensible and thoroughly maintained plugin infrastructure.
> {code}
> I suggest/propose something along the lines of
> {code:xml}
> Apache Nutch is an open source web-search software project. Stemming from Apache Lucene, the community now develops and maintains two branches:
> * 1.x; description of 1.x here
> * 2.x; description of 2.x here
> Both branches add web-specifics, such as a crawler, a link-graph database and parsing support handled by Apache Tika for HTML and anarray other document formats.
> Nutch can run on a single machine, but gains a lot of its strength from running in a Hadoop cluster
> The system can be enhanced (eg other document formats can be parsed) using a highly flexible, easily extensible and thoroughly maintained plugin infrastructure.
> {code}
> Any thoughts?
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira