You are viewing a plain text version of this content. The canonical link for it is here.
Posted to solr-user@lucene.apache.org by Pierre-Yves LANDRON <pl...@hotmail.com> on 2009/07/03 11:21:42 UTC
Stopwords when facetting
Hello,
When indexing or querying text, i'm using the solr.StopFilterFactory ; it seems to works just fine...
But I want to use the text field as a facet, and get all the commonly used words in a set of results, without the stopwords. As far as I tried, I always get stopwords, and numerical terms, that pollute my facets results. How can I perform this ?
Thanks,
Pierre
_________________________________________________________________
Drag n’ drop—Get easy photo sharing with Windows Live™ Photos.
http://www.microsoft.com/windows/windowslive/products/photos.aspx
Re: Stopwords when facetting
Posted by Chris Hostetter <ho...@fucit.org>.
: When indexing or querying text, i'm using the solr.StopFilterFactory ; it seems to works just fine...
:
: But I want to use the text field as a facet, and get all the commonly
: used words in a set of results, without the stopwords. As far as I
: tried, I always get stopwords, and numerical terms, that pollute my
: facets results. How can I perform this ?
perhaps you have the same problem as described here...
http://www.nabble.com/facets-and-stopwords-to23952823.html#a24379679
...it's hard to be certain without any actual concrete examples (what does
your schema.xml look like, what are you stopwords, what terms are still
showing up in your facet list even though they are stop words, what
documents contain those terms (the raw parser can help you find them...
q={!raw field=yourFieldName}wordYouDoNotExpect
-Hoss
RE: Browse indexed terms in a field
Posted by Pierre-Yves LANDRON <pl...@hotmail.com>.
Thanks !
it seems that can do the trick...
> Date: Tue, 7 Jul 2009 11:10:15 -0400
> Subject: Re: Browse indexed terms in a field
> From: bill.w.au@gmail.com
> To: solr-user@lucene.apache.org
>
> You can use facet.perfix to match the beginning of a given word:
>
> http://wiki.apache.org/solr/SimpleFacetParameters#head-579914ef3a14d775a5ac64d2c17a53f3364e3cf6
>
> Bill
>
> On Tue, Jul 7, 2009 at 11:02 AM, Pierre-Yves LANDRON
> <pl...@hotmail.com>wrote:
>
> >
> > Hello,
> >
> > Here is what I would like to achieve : in an indexed document there's a
> > fulltext indexed field ; I'd like to browse the terms in this field, ie. get
> > all the terms that match the begining of a given word, for example.
> > I can get all the field's facets for this document, but that's a lot of
> > terms to process ; is there a way to constraint the returned facets ?
> >
> > Thank you for your highlights.
> > Kind regards,
> > Pierre.
> >
> > _________________________________________________________________
> > More than messages–check out the rest of the Windows Live™.
> > http://www.microsoft.com/windows/windowslive/
_________________________________________________________________
Windows Live™: Keep your life in sync. Check it out!
http://windowslive.com/explore?ocid=TXT_TAGLM_WL_t1_allup_explore_012009
Re: Browse indexed terms in a field
Posted by Bill Au <bi...@gmail.com>.
You can use facet.perfix to match the beginning of a given word:
http://wiki.apache.org/solr/SimpleFacetParameters#head-579914ef3a14d775a5ac64d2c17a53f3364e3cf6
Bill
On Tue, Jul 7, 2009 at 11:02 AM, Pierre-Yves LANDRON
<pl...@hotmail.com>wrote:
>
> Hello,
>
> Here is what I would like to achieve : in an indexed document there's a
> fulltext indexed field ; I'd like to browse the terms in this field, ie. get
> all the terms that match the begining of a given word, for example.
> I can get all the field's facets for this document, but that's a lot of
> terms to process ; is there a way to constraint the returned facets ?
>
> Thank you for your highlights.
> Kind regards,
> Pierre.
>
> _________________________________________________________________
> More than messages–check out the rest of the Windows Live™.
> http://www.microsoft.com/windows/windowslive/
Browse indexed terms in a field
Posted by Pierre-Yves LANDRON <pl...@hotmail.com>.
Hello,
Here is what I would like to achieve : in an indexed document there's a fulltext indexed field ; I'd like to browse the terms in this field, ie. get all the terms that match the begining of a given word, for example.
I can get all the field's facets for this document, but that's a lot of terms to process ; is there a way to constraint the returned facets ?
Thank you for your highlights.
Kind regards,
Pierre.
_________________________________________________________________
More than messages–check out the rest of the Windows Live™.
http://www.microsoft.com/windows/windowslive/
Re: Stopwords when facetting
Posted by Erik Hatcher <er...@ehatchersolutions.com>.
Pierre - the field you're faceting must not have the StopFilter
applied at indexing time, or the words you want removed aren't in the
stop word list file.
Erik
On Jul 3, 2009, at 5:21 AM, Pierre-Yves LANDRON wrote:
>
> Hello,
>
> When indexing or querying text, i'm using the
> solr.StopFilterFactory ; it seems to works just fine...
>
> But I want to use the text field as a facet, and get all the
> commonly used words in a set of results, without the stopwords. As
> far as I tried, I always get stopwords, and numerical terms, that
> pollute my facets results. How can I perform this ?
>
> Thanks,
> Pierre
>
> _________________________________________________________________
> Drag n’ drop—Get easy photo sharing with Windows Live™ Photos.
>
> http://www.microsoft.com/windows/windowslive/products/photos.aspx