You are viewing a plain text version of this content. The canonical link for it is here.
Posted to solr-user@lucene.apache.org by ranjitr <co...@yahoo.com> on 2009/06/23 13:39:28 UTC
Re: SolrCore, reload, synonyms not reloaded
Hello,
I was having a similar problem during indexing with my synonyms file. But I
was able to resolve it using the steps you had outlined. Thanks!
I am wondering if there is a way to reload the index with a new synonym file
without Solr/Multi core support? I would really appreciate it if you could
post the steps to accomplish this.
hossman wrote:
>
>
> : I'm using Solr 1.3 and I've never been able to get the SolrCore
> (formerly
> : MultiCore) reload feature to pick up changes I made to my synonyms file.
> At
> : index time I expand synonyms. If I change my synonyms.txt file then do
> a
> : MultiCore RELOAD and then reindex my data and then do a query that
> should
> : work now that I added a synonym, it doesn't work. If I go to the
> analysis
> : page and try putting in the text I see that it did pick up the changes.
> I'm
> : forced to bring down the the webapp for the changes to truly be
> reloaded.
> : Has anyone else seen this?
>
> David: I don't really use the Multi Core support, but your problem
> descripting intrigued me so i tried it out, and i can *not* reproduce the
> problem you are having.
>
> Steps i took....
>
> 1) applied the patch listed at the end of this email to the Solr trunk.
> note that it adds a "text" field to the multicore "core1" example configs.
> this field uses SynonymFilter at index time. I also added a synonyms file
> with "chris, hostetter" as the only entry.
>
> 2) cd example; java -Dsolr.solr.home=multicore -jar start.jar
>
> 3) java -Ddata=args -Durl=http://localhost:8983/solr/core1/update -jar
> post.jar '<add><doc><field name="id">1</field><field name="text">chris and
> david</field></doc></add>'
>
> 4) checked luke handler, confirmed that chris, hostetter, and, & david
> were indexed terms.
>
> 5) added "david, smiley" to my synonyms file
>
> 6) http://localhost:8983/solr/admin/cores?action=RELOAD&core=core1
>
> 7) repeated step #3
>
> 8) confirmed with luke that "smiley" was now an indexed term. also
> confirmed that query for text:smiley found my doc
>
>
> Here's the patch...
>
>
>
> Index: example/multicore/core1/conf/schema.xml
> ===================================================================
> --- example/multicore/core1/conf/schema.xml (revision 693303)
> +++ example/multicore/core1/conf/schema.xml (working copy)
> @@ -19,6 +19,18 @@
> <schema name="example core one" version="1.1">
> <types>
> <fieldtype name="string" class="solr.StrField" sortMissingLast="true"
> omitNorms="true"/>
> +
> + <fieldType name="text" class="solr.TextField"
> positionIncrementGap="100">
> + <analyzer type="index">
> + <tokenizer class="solr.WhitespaceTokenizerFactory"/>
> + <filter class="solr.LowerCaseFilterFactory"/>
> + <filter class="solr.SynonymFilterFactory"
> synonyms="index_synonyms.txt" ignoreCase="true" expand="true"/>
> + </analyzer>
> + <analyzer type="query">
> + <tokenizer class="solr.WhitespaceTokenizerFactory"/>
> + <filter class="solr.LowerCaseFilterFactory"/>
> + </analyzer>
> + </fieldType>
> </types>
>
> <fields>
> @@ -27,6 +39,7 @@
> <field name="type" type="string" indexed="true" stored="true"
> multiValued="false" />
> <field name="name" type="string" indexed="true" stored="true"
> multiValued="false" />
> <field name="core1" type="string" indexed="true" stored="true"
> multiValued="false" />
> + <field name="text" type="text" indexed="true" stored="true"
> multiValued="false" />
> </fields>
>
> <!-- field to use to determine and enforce document uniqueness. -->
> Index: example/multicore/core1/conf/index_synonyms.txt
> ===================================================================
> --- example/multicore/core1/conf/index_synonyms.txt (revision 0)
> +++ example/multicore/core1/conf/index_synonyms.txt (revision 0)
> @@ -0,0 +1,2 @@
> +chris, hostetter
> +
>
> Property changes on: example/multicore/core1/conf/index_synonyms.txt
> ___________________________________________________________________
> Name: svn:keywords
> + Date Author Id Revision HeadURL
> Name: svn:eol-style
> + native
>
>
>
>
--
View this message in context: http://www.nabble.com/SolrCore%2C-reload%2C-synonyms-not-reloaded-tp19339767p24164306.html
Sent from the Solr - User mailing list archive at Nabble.com.
Re: SolrCore, reload, synonyms not reloaded
Posted by ranjitr <co...@yahoo.com>.
Thank you, Noble.
The other problem seems to be that with Solr 1.3 release, I am not able to
RELOAD the index often (e.g. every minute) while I can do that with the
nightly-build/trunk code.
E.g. try issuing
http://localhost:8983/solr/admin/cores?action=RELOAD&core=core1
every 5 seconds.
Are you folks seeing the same issue as well?
Thanks.
Noble Paul നോബിള് नोब्ळ्-2 wrote:
>
> a singlecore single system has no admin commands.But it is possible to
> setup a multicore with only one core and you will be able to reload
> the core
>
> On Tue, Jun 23, 2009 at 5:09 PM, ranjitr <co...@yahoo.com>
> wrote:
>>
>> Hello,
>>
>> I was having a similar problem during indexing with my synonyms file. But
>> I
>> was able to resolve it using the steps you had outlined. Thanks!
>>
>> I am wondering if there is a way to reload the index with a new synonym
>> file
>> without Solr/Multi core support? I would really appreciate it if you
>> could
>> post the steps to accomplish this.
>>
>>
>>
>>
>>
>> hossman wrote:
>> >
>> >
>> > : I'm using Solr 1.3 and I've never been able to get the SolrCore
>> > (formerly
>> > : MultiCore) reload feature to pick up changes I made to my synonyms
>> file.
>> > At
>> > : index time I expand synonyms. If I change my synonyms.txt file then
>> do
>> > a
>> > : MultiCore RELOAD and then reindex my data and then do a query that
>> > should
>> > : work now that I added a synonym, it doesn't work. If I go to the
>> > analysis
>> > : page and try putting in the text I see that it did pick up the
>> changes.
>> > I'm
>> > : forced to bring down the the webapp for the changes to truly be
>> > reloaded.
>> > : Has anyone else seen this?
>> >
>> > David: I don't really use the Multi Core support, but your problem
>> > descripting intrigued me so i tried it out, and i can *not* reproduce
>> the
>> > problem you are having.
>> >
>> > Steps i took....
>> >
>> > 1) applied the patch listed at the end of this email to the Solr trunk.
>> > note that it adds a "text" field to the multicore "core1" example
>> configs.
>> > this field uses SynonymFilter at index time. I also added a synonyms
>> file
>> > with "chris, hostetter" as the only entry.
>> >
>> > 2) cd example; java -Dsolr.solr.home=multicore -jar start.jar
>> >
>> > 3) java -Ddata=args -Durl=http://localhost:8983/solr/core1/update -jar
>> > post.jar '<add><doc><field name="id">1</field><field name="text">chris
>> and
>> > david</field></doc></add>'
>> >
>> > 4) checked luke handler, confirmed that chris, hostetter, and, & david
>> > were indexed terms.
>> >
>> > 5) added "david, smiley" to my synonyms file
>> >
>> > 6) http://localhost:8983/solr/admin/cores?action=RELOAD&core=core1
>> >
>> > 7) repeated step #3
>> >
>> > 8) confirmed with luke that "smiley" was now an indexed term. also
>> > confirmed that query for text:smiley found my doc
>> >
>> >
>> > Here's the patch...
>> >
>> >
>> >
>> > Index: example/multicore/core1/conf/schema.xml
>> > ===================================================================
>> > --- example/multicore/core1/conf/schema.xml (revision 693303)
>> > +++ example/multicore/core1/conf/schema.xml (working copy)
>> > @@ -19,6 +19,18 @@
>> > <schema name="example core one" version="1.1">
>> > <types>
>> > <fieldtype name="string" class="solr.StrField"
>> sortMissingLast="true"
>> > omitNorms="true"/>
>> > +
>> > + <fieldType name="text" class="solr.TextField"
>> > positionIncrementGap="100">
>> > + <analyzer type="index">
>> > + <tokenizer class="solr.WhitespaceTokenizerFactory"/>
>> > + <filter class="solr.LowerCaseFilterFactory"/>
>> > + <filter class="solr.SynonymFilterFactory"
>> > synonyms="index_synonyms.txt" ignoreCase="true" expand="true"/>
>> > + </analyzer>
>> > + <analyzer type="query">
>> > + <tokenizer class="solr.WhitespaceTokenizerFactory"/>
>> > + <filter class="solr.LowerCaseFilterFactory"/>
>> > + </analyzer>
>> > + </fieldType>
>> > </types>
>> >
>> > <fields>
>> > @@ -27,6 +39,7 @@
>> > <field name="type" type="string" indexed="true"
>> stored="true"
>> > multiValued="false" />
>> > <field name="name" type="string" indexed="true"
>> stored="true"
>> > multiValued="false" />
>> > <field name="core1" type="string" indexed="true"
>> stored="true"
>> > multiValued="false" />
>> > + <field name="text" type="text" indexed="true" stored="true"
>> > multiValued="false" />
>> > </fields>
>> >
>> > <!-- field to use to determine and enforce document uniqueness. -->
>> > Index: example/multicore/core1/conf/index_synonyms.txt
>> > ===================================================================
>> > --- example/multicore/core1/conf/index_synonyms.txt (revision 0)
>> > +++ example/multicore/core1/conf/index_synonyms.txt (revision 0)
>> > @@ -0,0 +1,2 @@
>> > +chris, hostetter
>> > +
>> >
>> > Property changes on: example/multicore/core1/conf/index_synonyms.txt
>> > ___________________________________________________________________
>> > Name: svn:keywords
>> > + Date Author Id Revision HeadURL
>> > Name: svn:eol-style
>> > + native
>> >
>> >
>> >
>> >
>>
>> --
>> View this message in context:
>> http://www.nabble.com/SolrCore%2C-reload%2C-synonyms-not-reloaded-tp19339767p24164306.html
>> Sent from the Solr - User mailing list archive at Nabble.com.
>>
>
>
>
> --
> -----------------------------------------------------
> Noble Paul | Principal Engineer| AOL | http://aol.com
>
>
--
View this message in context: http://www.nabble.com/SolrCore%2C-reload%2C-synonyms-not-reloaded-tp19339767p24185690.html
Sent from the Solr - User mailing list archive at Nabble.com.
Re: SolrCore, reload, synonyms not reloaded
Posted by Noble Paul നോബിള് नोब्ळ् <no...@corp.aol.com>.
a singlecore single system has no admin commands.But it is possible to
setup a multicore with only one core and you will be able to reload
the core
On Tue, Jun 23, 2009 at 5:09 PM, ranjitr <co...@yahoo.com> wrote:
>
> Hello,
>
> I was having a similar problem during indexing with my synonyms file. But I
> was able to resolve it using the steps you had outlined. Thanks!
>
> I am wondering if there is a way to reload the index with a new synonym file
> without Solr/Multi core support? I would really appreciate it if you could
> post the steps to accomplish this.
>
>
>
>
>
> hossman wrote:
> >
> >
> > : I'm using Solr 1.3 and I've never been able to get the SolrCore
> > (formerly
> > : MultiCore) reload feature to pick up changes I made to my synonyms file.
> > At
> > : index time I expand synonyms. If I change my synonyms.txt file then do
> > a
> > : MultiCore RELOAD and then reindex my data and then do a query that
> > should
> > : work now that I added a synonym, it doesn't work. If I go to the
> > analysis
> > : page and try putting in the text I see that it did pick up the changes.
> > I'm
> > : forced to bring down the the webapp for the changes to truly be
> > reloaded.
> > : Has anyone else seen this?
> >
> > David: I don't really use the Multi Core support, but your problem
> > descripting intrigued me so i tried it out, and i can *not* reproduce the
> > problem you are having.
> >
> > Steps i took....
> >
> > 1) applied the patch listed at the end of this email to the Solr trunk.
> > note that it adds a "text" field to the multicore "core1" example configs.
> > this field uses SynonymFilter at index time. I also added a synonyms file
> > with "chris, hostetter" as the only entry.
> >
> > 2) cd example; java -Dsolr.solr.home=multicore -jar start.jar
> >
> > 3) java -Ddata=args -Durl=http://localhost:8983/solr/core1/update -jar
> > post.jar '<add><doc><field name="id">1</field><field name="text">chris and
> > david</field></doc></add>'
> >
> > 4) checked luke handler, confirmed that chris, hostetter, and, & david
> > were indexed terms.
> >
> > 5) added "david, smiley" to my synonyms file
> >
> > 6) http://localhost:8983/solr/admin/cores?action=RELOAD&core=core1
> >
> > 7) repeated step #3
> >
> > 8) confirmed with luke that "smiley" was now an indexed term. also
> > confirmed that query for text:smiley found my doc
> >
> >
> > Here's the patch...
> >
> >
> >
> > Index: example/multicore/core1/conf/schema.xml
> > ===================================================================
> > --- example/multicore/core1/conf/schema.xml (revision 693303)
> > +++ example/multicore/core1/conf/schema.xml (working copy)
> > @@ -19,6 +19,18 @@
> > <schema name="example core one" version="1.1">
> > <types>
> > <fieldtype name="string" class="solr.StrField" sortMissingLast="true"
> > omitNorms="true"/>
> > +
> > + <fieldType name="text" class="solr.TextField"
> > positionIncrementGap="100">
> > + <analyzer type="index">
> > + <tokenizer class="solr.WhitespaceTokenizerFactory"/>
> > + <filter class="solr.LowerCaseFilterFactory"/>
> > + <filter class="solr.SynonymFilterFactory"
> > synonyms="index_synonyms.txt" ignoreCase="true" expand="true"/>
> > + </analyzer>
> > + <analyzer type="query">
> > + <tokenizer class="solr.WhitespaceTokenizerFactory"/>
> > + <filter class="solr.LowerCaseFilterFactory"/>
> > + </analyzer>
> > + </fieldType>
> > </types>
> >
> > <fields>
> > @@ -27,6 +39,7 @@
> > <field name="type" type="string" indexed="true" stored="true"
> > multiValued="false" />
> > <field name="name" type="string" indexed="true" stored="true"
> > multiValued="false" />
> > <field name="core1" type="string" indexed="true" stored="true"
> > multiValued="false" />
> > + <field name="text" type="text" indexed="true" stored="true"
> > multiValued="false" />
> > </fields>
> >
> > <!-- field to use to determine and enforce document uniqueness. -->
> > Index: example/multicore/core1/conf/index_synonyms.txt
> > ===================================================================
> > --- example/multicore/core1/conf/index_synonyms.txt (revision 0)
> > +++ example/multicore/core1/conf/index_synonyms.txt (revision 0)
> > @@ -0,0 +1,2 @@
> > +chris, hostetter
> > +
> >
> > Property changes on: example/multicore/core1/conf/index_synonyms.txt
> > ___________________________________________________________________
> > Name: svn:keywords
> > + Date Author Id Revision HeadURL
> > Name: svn:eol-style
> > + native
> >
> >
> >
> >
>
> --
> View this message in context: http://www.nabble.com/SolrCore%2C-reload%2C-synonyms-not-reloaded-tp19339767p24164306.html
> Sent from the Solr - User mailing list archive at Nabble.com.
>
--
-----------------------------------------------------
Noble Paul | Principal Engineer| AOL | http://aol.com