RE(2): Should Token be immutable?

[Cheryl Card <ch...@teamware.co.uk>]

> I know a person who submitted Finish Analyzer,a looong time ago had
> mentioned this same thing - storing multiple variations of the word in
> the same position.
>
> Otis

A former colleague produced a Finnish Analyzer and I've recently taken over 
responsibility for it. It makes use of setPositionIncrement.

Cheryl Card

--
To unsubscribe, e-mail:   <ma...@jakarta.apache.org>
For additional commands, e-mail: <ma...@jakarta.apache.org>

Re: RE(2): Should Token be immutable?

[Otis Gospodnetic <ot...@yahoo.com>]

Since Doug added Snowball stemmers to Lucene Sandbox, and since one of
them if for Finnish, I've been wondering if that one uses
setPositionIncrement.

I've also been wondering if we keep the Russian and German
stemmers/analyzers/filters/... that are in core Lucene, or if we should
remove/deprecate those and instruct people to use the Snowball ones.

If anyone has any thoughts - share them.  I personally don't use any of
them yet.

Otis


--- Cheryl Card <ch...@teamware.co.uk> wrote:
> > I know a person who submitted Finish Analyzer,a looong time ago had
> > mentioned this same thing - storing multiple variations of the word
> in
> > the same position.
> >
> > Otis
> 
> A former colleague produced a Finnish Analyzer and I've recently
> taken over 
> responsibility for it. It makes use of setPositionIncrement.
> 
> Cheryl Card
> 
> --
> To unsubscribe, e-mail:  
> <ma...@jakarta.apache.org>
> For additional commands, e-mail:
> <ma...@jakarta.apache.org>
> 


__________________________________________________
Do you Yahoo!?
Yahoo! Mail Plus - Powerful. Affordable. Sign up now.
http://mailplus.yahoo.com

--
To unsubscribe, e-mail:   <ma...@jakarta.apache.org>
For additional commands, e-mail: <ma...@jakarta.apache.org>