You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@nutch.apache.org by DS jha <ae...@gmail.com> on 2007/01/19 18:14:30 UTC

how to use PorterStemFilter with NutchDocumentAnalyzer

Hello –

I want to use PorterStemFilter (along with LowerCaseTokenizer) from
Lucene library – and was wondering, how would I do it in Nutch. I can
extend DocumentAnalyzer class for returning PorterStemFilter  and add
the plugin the config file - however, in that scenario I think
NutchDocumentAnalyzer won't get called – so is there a way to invoke
PorterStemFilter before/after NutchDocumentAnalyzer?


Thanks,
DS Jha

Re: how to use PorterStemFilter with NutchDocumentAnalyzer

Posted by Alvaro Cabrerizo <to...@gmail.com>.
Sorry but, don´t understand what you mean whit "will that impact my search
results?"



2007/1/23, DS jha <ae...@gmail.com>:
>
> yeah - you are right. I can implement this by extending NutchAnalyzer
> - however, that will bypass current NutchDocumentAnalyzer and
> CommonGrams functionality - will that impact my search results?
>
> Thanks,
>
>
> On 1/23/07, Alvaro Cabrerizo <to...@gmail.com> wrote:
> > Hello:
> >
> > At least in nutch-0.8 you can find two plugins analysis-es and
> analysis-de.
> > The source code of this plugins is the best guide you can follow to
> > implement your "Analyzer".
> >
> > 2007/1/19, DS jha <ae...@gmail.com>:
> > >
> > > Hello –
> > >
> > > I want to use PorterStemFilter (along with LowerCaseTokenizer) from
> > > Lucene library – and was wondering, how would I do it in Nutch. I can
> > > extend DocumentAnalyzer class for returning PorterStemFilter  and add
> > > the plugin the config file - however, in that scenario I think
> > > NutchDocumentAnalyzer won't get called – so is there a way to invoke
> > > PorterStemFilter before/after NutchDocumentAnalyzer?
> > >
> > >
> > > Thanks,
> > > DS Jha
> > >
> >
> >
>

Re: how to use PorterStemFilter with NutchDocumentAnalyzer

Posted by DS jha <ae...@gmail.com>.
yeah - you are right. I can implement this by extending NutchAnalyzer
- however, that will bypass current NutchDocumentAnalyzer and
CommonGrams functionality - will that impact my search results?

Thanks,


On 1/23/07, Alvaro Cabrerizo <to...@gmail.com> wrote:
> Hello:
>
> At least in nutch-0.8 you can find two plugins analysis-es and analysis-de.
> The source code of this plugins is the best guide you can follow to
> implement your "Analyzer".
>
> 2007/1/19, DS jha <ae...@gmail.com>:
> >
> > Hello –
> >
> > I want to use PorterStemFilter (along with LowerCaseTokenizer) from
> > Lucene library – and was wondering, how would I do it in Nutch. I can
> > extend DocumentAnalyzer class for returning PorterStemFilter  and add
> > the plugin the config file - however, in that scenario I think
> > NutchDocumentAnalyzer won't get called – so is there a way to invoke
> > PorterStemFilter before/after NutchDocumentAnalyzer?
> >
> >
> > Thanks,
> > DS Jha
> >
>
>

Re: how to use PorterStemFilter with NutchDocumentAnalyzer

Posted by Alvaro Cabrerizo <to...@gmail.com>.
Hello:

At least in nutch-0.8 you can find two plugins analysis-es and analysis-de.
The source code of this plugins is the best guide you can follow to
implement your "Analyzer".

2007/1/19, DS jha <ae...@gmail.com>:
>
> Hello –
>
> I want to use PorterStemFilter (along with LowerCaseTokenizer) from
> Lucene library – and was wondering, how would I do it in Nutch. I can
> extend DocumentAnalyzer class for returning PorterStemFilter  and add
> the plugin the config file - however, in that scenario I think
> NutchDocumentAnalyzer won't get called – so is there a way to invoke
> PorterStemFilter before/after NutchDocumentAnalyzer?
>
>
> Thanks,
> DS Jha
>