Plugins for features

[karthik085 <ka...@gmail.com>]

What nutch plugins are available, that can do a similar job to these
following Google features? (More about google features:
http://www.google.com/advanced_search?hl=en)
* File format :
* Date
* Domain
* Topic-specific searches (Web/Images/Video...)
* Search within results
* Q/A (For example, 'weather 60004' gives weather data for Arlington Height,
IL)
* Suggest
* Did you mean?
* Similar pages
* Analytics

Are there any of these features already implemented in Nutch? Any other way,
without using plugins? With what version does these plugins work with?
-- 
View this message in context: http://www.nabble.com/Plugins-for-features-tf2917806.html#a8154236
Sent from the Nutch - User mailing list archive at Nabble.com.

Re: Plugins for features

[Enis Soztutar <en...@gmail.com>]

karthik085 wrote:
> What nutch plugins are available, that can do a similar job to these
> following Google features? (More about google features:
> http://www.google.com/advanced_search?hl=en)
> * File format :
> * Date
> * Domain
> * Topic-specific searches (Web/Images/Video...)
> * Search within results
> * Q/A (For example, 'weather 60004' gives weather data for Arlington Height,
> IL)
> * Suggest
> * Did you mean?
> * Similar pages
> * Analytics
>
> Are there any of these features already implemented in Nutch? Any other way,
> without using plugins? With what version does these plugins work with?
>   
Hi,

Well not all of them is implemented in nutch. Obviously, this is because 
some of the tasks is very challenging and some of them could be a 
project themselves.

To start with, you can index file formats and dates by using index-more 
plugin. And these can be queried with query-more plugin. Topic specific 
searches can be imitated by searching on mime type fields.  However, 
this is not a straightforward solution. Searching within results is not 
implemented either, although it is not difficult.


Question answering is some broad topic. Hakia and Start are two 
references. But as far as i understood, by Q/A you refer to googles 
solution. Google forwards the query to, say whether server or finance 
server, by a query dispatcher and displays the results along with the 
regular query results. To implement such a feature, you should have the 
whether, finance, or say music data. As far as I know, this is not one 
of the project goals at nutch.

Spell checker is implemented under contrib/web2 directory.

RE: Plugins for features

[Alan Tanaman <al...@idna-solutions.com>]

Almost everything domain-specific in Nutch is performed by means of some
kind of plugin.  Nutch itself is a kind of framework that holds all the
plugins together.  It doesn't bother itself with interpreting the specific
details such as protocol, parsing, meta-data, etc., but rather hands this
over to the plugins through clearly defined extension points.  This kind of
architecture means that it is both extremely flexible and adaptable to
future changes in technology.

To start, I would suggest visiting the FAQ and on to PluginCentral.  These
can both be accessed from the Wiki home page at
http://wiki.apache.org/nutch/.

The index-basic, index-more and index-extra plugins can handle many of your
requirements to add fields to the index (similar to the Google features),
and are fully documented.

There are other plugins that could complete your requirements (ontology
maybe?), but you may also find that you need to write a few (which we may
all find useful). ;)

Best regards,
Alan
_________________________
Alan Tanaman
iDNA Solutions

-----Original Message-----
From: karthik085 [mailto:karthik085@gmail.com] 
Sent: 04 January 2007 05:30
To: nutch-user@lucene.apache.org
Subject: Plugins for features


What nutch plugins are available, that can do a similar job to these
following Google features? (More about google features:
http://www.google.com/advanced_search?hl=en)
* File format :
* Date
* Domain
* Topic-specific searches (Web/Images/Video...)
* Search within results
* Q/A (For example, 'weather 60004' gives weather data for Arlington Height,
IL)
* Suggest
* Did you mean?
* Similar pages
* Analytics

Are there any of these features already implemented in Nutch? Any other way,
without using plugins? With what version does these plugins work with?
-- 
View this message in context:
http://www.nabble.com/Plugins-for-features-tf2917806.html#a8154236
Sent from the Nutch - User mailing list archive at Nabble.com.