You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@nutch.apache.org by martin <ma...@gmail.com> on 2007/09/04 12:25:32 UTC

Can i use my own analyzer to build index and search instead nutch default analyzer?

Hi all:
    I'm  fresh to nutch.Can i use my own analyzer , which is based on
lucene  to build index and search instead nutch default analyzer.write a new
plugin? or nutch support such as config file?I haven't find any useful
document right now:(

Re: Can i use my own analyzer to build index and search instead nutch default analyzer?

Posted by Doğacan Güney <do...@gmail.com>.
On 9/4/07, martin <ma...@gmail.com> wrote:
> Hi all:
>     I'm  fresh to nutch.Can i use my own analyzer , which is based on
> lucene  to build index and search instead nutch default analyzer.write a new
> plugin? or nutch support such as config file?I haven't find any useful
> document right now:(

Nutch supports different analyzers, but it is a bit limited. By
default, documents are analyzed with NutchDocumentAnalyzer. If an
analysis plugin is enabled (such as analysis-fr), and a document is
written a language specified by an analysis plugin, that document is
analyzed by the plugin instead of NutchDocumentAnalyzer.

For example, analysis-fr is for analyzing French documents so if a
document is in French (probably recognized by language-identifier)
then that document is analyzed by analysis-fr, instead of default
analyzer.

So, you can either define a new analyzer plugin or change
NutchDocumentAnalyzer to process documents with a different analyzer.

(PS:As I said before, this scheme is a bit limited and it is actually
one of the things that we want to improve. )

>


-- 
Doğacan Güney