Solr 1.4 - Stemmer expansion

[Saïd Radhouani <r....@gmail.com>]

I'm using the SnowballPorterFilterFactory for stemming French words. Some
words are not reconginized by this stemmer; I wonder wether, like synonyms
processing, the stemmers have the option of expansion.

Thanks.

Re: Solr 1.4 - Stemmer expansion

[Erick Erickson <er...@gmail.com>]

Stemming doesn't work perfectly. It's algorithmic, so there
will always be some words that don't stem as they should.
Perhaps you've hit one of those cases, which is what I'd
expect if the rest of your words stem correctly.

But since SOLR is build on Lucene, and the SnowBallAnalyzers
in lucene only have StopWords, I doubt there's an expansion list...

FWIW
Erick

On Wed, Mar 17, 2010 at 10:24 AM, Saïd Radhouani <r....@gmail.com>wrote:

> The configuration is correct and it works perfectly for French. So far, all
> the French words I tried got stemmed correctly; except the word "studios".
> This is why I thought about expansion,  perhaps I might need it for other
> words.
>
> Thanks,
> -Saïd
>
>
> 2010/3/17 Erick Erickson <er...@gmail.com>
>
> > Did you specify language="French"? Did you re-index
> > after specifying this? Can you give some examples of
> > unrecognized words? Did you look in your index to see what
> > was actually indexed via the admin pages and/or Luke?
> > Did you use &debugQuery=on to see how your search
> > was parsed? Could you post your schema definitions for
> > the field in question so folks can look at it?
> >
> > We need some details in order to actually be helpful <G>...
> >
> > Best
> > Erick
> >
> > On Wed, Mar 17, 2010 at 5:05 AM, Saïd Radhouani <r.steve.pdx@gmail.com
> > >wrote:
> >
> > > I'm using the SnowballPorterFilterFactory for stemming French words.
> Some
> > > words are not reconginized by this stemmer; I wonder wether, like
> > synonyms
> > > processing, the stemmers have the option of expansion.
> > >
> > > Thanks.
> > >
> >
>

Re: Solr 1.4 - Stemmer expansion

[Saïd Radhouani <r....@gmail.com>]

The configuration is correct and it works perfectly for French. So far, all
the French words I tried got stemmed correctly; except the word "studios".
This is why I thought about expansion,  perhaps I might need it for other
words.

Thanks,
-Saïd


2010/3/17 Erick Erickson <er...@gmail.com>

> Did you specify language="French"? Did you re-index
> after specifying this? Can you give some examples of
> unrecognized words? Did you look in your index to see what
> was actually indexed via the admin pages and/or Luke?
> Did you use &debugQuery=on to see how your search
> was parsed? Could you post your schema definitions for
> the field in question so folks can look at it?
>
> We need some details in order to actually be helpful <G>...
>
> Best
> Erick
>
> On Wed, Mar 17, 2010 at 5:05 AM, Saïd Radhouani <r.steve.pdx@gmail.com
> >wrote:
>
> > I'm using the SnowballPorterFilterFactory for stemming French words. Some
> > words are not reconginized by this stemmer; I wonder wether, like
> synonyms
> > processing, the stemmers have the option of expansion.
> >
> > Thanks.
> >
>

Re: Solr 1.4 - Stemmer expansion

[Erick Erickson <er...@gmail.com>]

Did you specify language="French"? Did you re-index
after specifying this? Can you give some examples of
unrecognized words? Did you look in your index to see what
was actually indexed via the admin pages and/or Luke?
Did you use &debugQuery=on to see how your search
was parsed? Could you post your schema definitions for
the field in question so folks can look at it?

We need some details in order to actually be helpful <G>...

Best
Erick

On Wed, Mar 17, 2010 at 5:05 AM, Saïd Radhouani <r....@gmail.com>wrote:

> I'm using the SnowballPorterFilterFactory for stemming French words. Some
> words are not reconginized by this stemmer; I wonder wether, like synonyms
> processing, the stemmers have the option of expansion.
>
> Thanks.
>