You are viewing a plain text version of this content. The canonical link for it is here.
Posted to solr-user@lucene.apache.org by "Jamal, Sarfaraz" <Sa...@VerizonWireless.com.INVALID> on 2016/06/03 18:12:09 UTC
Stemming Help
Hi Guys,
I am following this tutorial:
http://thinknook.com/keyword-stemming-and-lemmatisation-with-apache-solr-2013-08-02/
My (Managed) Schema file looks like this: (in the appropriate places)
- <field name="content_stemming" type="text_stem" indexed="true" stored="true" />
- <fieldType name="text_stem" class="solr.TextField" positionIncrementGap="100">
<analyzer>
<tokenizer class="solr.WhitespaceTokenizerFactory"/>
<filter class="solr.SnowballPorterFilterFactory"/>
</analyzer>
</fieldType>
- <field name="content_stemming" type="text_stem" indexed="true" stored="true" />
- <copyField source="_text_" dest="content_stemming"/>
I have re-indexed everything -
It is not effecting my search at all -
- from what I can tell from the analysis tool nothing is happening.
Is there something else I am missing or should take a look at, or is it possible to debug this? Or some other documentation I can search though?
Thanks!
Sas
-----Original Message-----
From: Shawn Heisey [mailto:apache@elyograg.org]
Sent: Friday, June 3, 2016 2:02 PM
To: solr-user@lucene.apache.org
Subject: Re: [E] Re: Stemming and Managed Schema
On 6/3/2016 9:22 AM, Jamal, Sarfaraz wrote:
> I would edit the managed-schema, make my changes, shutdown solr? And
> start it back up and verify it is still there?
That's the sledgehammer approach. Simple and effective, but Solr does go offline for a short time.
> Or is there another way to reload the core/collection?
For SolrCloud:
https://cwiki.apache.org/confluence/display/solr/Collections+API#CollectionsAPI-api2
For non-cloud mode:
https://cwiki.apache.org/confluence/display/solr/CoreAdmin+API#CoreAdminAPI-RELOAD
Thanks,
Shawn
Re: Stemming Help
Posted by Doug Turnbull <dt...@opensourceconnections.com>.
What output are you seeing exactly from the analysis UI?
It's also interesting you're not lowercasing after tokeinzation.
On Sun, Jun 5, 2016 at 10:42 AM Georg Sorst <ge...@gmail.com> wrote:
> Without having more context:
>
> How do you know that it is not working?
> What is the output you are getting in the analysis tool?
> Do the analysis steps in the output match your configuration?
> Are you sure you selected the right field / field type before running the
> analysis?
>
> Jamal, Sarfaraz <Sa...@verizonwireless.com.invalid> schrieb am
> Fr., 3. Juni 2016 um 20:12 Uhr:
>
> > Hi Guys,
> >
> > I am following this tutorial:
> >
> >
> http://thinknook.com/keyword-stemming-and-lemmatisation-with-apache-solr-2013-08-02/
> >
> > My (Managed) Schema file looks like this: (in the appropriate places)
> >
> >
> > - <field name="content_stemming" type="text_stem" indexed="true"
> > stored="true" />
> >
> > - <fieldType name="text_stem" class="solr.TextField"
> > positionIncrementGap="100">
> > <analyzer>
> > <tokenizer class="solr.WhitespaceTokenizerFactory"/>
> > <filter class="solr.SnowballPorterFilterFactory"/>
> > </analyzer>
> > </fieldType>
> >
> > - <field name="content_stemming" type="text_stem" indexed="true"
> > stored="true" />
> >
> > - <copyField source="_text_" dest="content_stemming"/>
> >
> > I have re-indexed everything -
> >
> > It is not effecting my search at all -
> >
> > - from what I can tell from the analysis tool nothing is happening.
> >
> > Is there something else I am missing or should take a look at, or is it
> > possible to debug this? Or some other documentation I can search though?
> >
> > Thanks!
> >
> > Sas
> >
> > -----Original Message-----
> > From: Shawn Heisey [mailto:apache@elyograg.org]
> > Sent: Friday, June 3, 2016 2:02 PM
> > To: solr-user@lucene.apache.org
> > Subject: Re: [E] Re: Stemming and Managed Schema
> >
> > On 6/3/2016 9:22 AM, Jamal, Sarfaraz wrote:
> > > I would edit the managed-schema, make my changes, shutdown solr? And
> > > start it back up and verify it is still there?
> >
> > That's the sledgehammer approach. Simple and effective, but Solr does go
> > offline for a short time.
> >
> > > Or is there another way to reload the core/collection?
> >
> > For SolrCloud:
> >
> >
> https://cwiki.apache.org/confluence/display/solr/Collections+API#CollectionsAPI-api2
> >
> > For non-cloud mode:
> >
> >
> https://cwiki.apache.org/confluence/display/solr/CoreAdmin+API#CoreAdminAPI-RELOAD
> >
> > Thanks,
> > Shawn
> >
> >
>
Re: Stemming Help
Posted by Georg Sorst <ge...@gmail.com>.
Without having more context:
How do you know that it is not working?
What is the output you are getting in the analysis tool?
Do the analysis steps in the output match your configuration?
Are you sure you selected the right field / field type before running the
analysis?
Jamal, Sarfaraz <Sa...@verizonwireless.com.invalid> schrieb am
Fr., 3. Juni 2016 um 20:12 Uhr:
> Hi Guys,
>
> I am following this tutorial:
>
> http://thinknook.com/keyword-stemming-and-lemmatisation-with-apache-solr-2013-08-02/
>
> My (Managed) Schema file looks like this: (in the appropriate places)
>
>
> - <field name="content_stemming" type="text_stem" indexed="true"
> stored="true" />
>
> - <fieldType name="text_stem" class="solr.TextField"
> positionIncrementGap="100">
> <analyzer>
> <tokenizer class="solr.WhitespaceTokenizerFactory"/>
> <filter class="solr.SnowballPorterFilterFactory"/>
> </analyzer>
> </fieldType>
>
> - <field name="content_stemming" type="text_stem" indexed="true"
> stored="true" />
>
> - <copyField source="_text_" dest="content_stemming"/>
>
> I have re-indexed everything -
>
> It is not effecting my search at all -
>
> - from what I can tell from the analysis tool nothing is happening.
>
> Is there something else I am missing or should take a look at, or is it
> possible to debug this? Or some other documentation I can search though?
>
> Thanks!
>
> Sas
>
> -----Original Message-----
> From: Shawn Heisey [mailto:apache@elyograg.org]
> Sent: Friday, June 3, 2016 2:02 PM
> To: solr-user@lucene.apache.org
> Subject: Re: [E] Re: Stemming and Managed Schema
>
> On 6/3/2016 9:22 AM, Jamal, Sarfaraz wrote:
> > I would edit the managed-schema, make my changes, shutdown solr? And
> > start it back up and verify it is still there?
>
> That's the sledgehammer approach. Simple and effective, but Solr does go
> offline for a short time.
>
> > Or is there another way to reload the core/collection?
>
> For SolrCloud:
>
> https://cwiki.apache.org/confluence/display/solr/Collections+API#CollectionsAPI-api2
>
> For non-cloud mode:
>
> https://cwiki.apache.org/confluence/display/solr/CoreAdmin+API#CoreAdminAPI-RELOAD
>
> Thanks,
> Shawn
>
>