You are viewing a plain text version of this content. The canonical link for it is here.
Posted to solr-user@lucene.apache.org by "Vinay B," <vy...@gmail.com> on 2013/11/07 18:43:53 UTC
Question on Lots Of cores - How do I know it's working
As I understand it, the "lots of cores" features enables dynamic loading
and unloading of cores
This is how I set up my solr.xml for a test where I created more cores than
the transientCacheSize.
Here is a link to the config in case it doesn't format well via this post.
https://gist.github.com/anonymous/7358674
Question: How do I know this feature is working i.e. is there something I
should watch for on the web container log, etc ? When I inspect the solr
admin GUI, I can see all the cores I created.
Thanks,
VIn
solr.xml
<?xml version="1.0" encoding="UTF-8" ?>
<solr persistent="true" sharedLib="lib">
<cores adminPath="/admin/cores" transientCacheSize="3" >
<core name="mycore_0001" loadOnStartup="false" instanceDir="cores"
transient="true" dataDir="mycore_0001"/>
<core name="mycore_7430341611573840011" loadOnStartup="false"
instanceDir="cores" transient="true" dataDir="mycore_7430341611573840011"/>
<core name="mycore_7697631832332862479" loadOnStartup="false"
instanceDir="cores" transient="true" dataDir="mycore_7697631832332862479"/>
<core name="mycore_7791568344662376737" loadOnStartup="false"
instanceDir="cores" transient="true" dataDir="mycore_7791568344662376737"/>
<core name="mycore_8169706828529363612" loadOnStartup="false"
instanceDir="cores" transient="true" dataDir="mycore_8169706828529363612"/>
<core name="dummy" loadOnStartup="true" instanceDir="cores/"
schema="schema.xml" transient="false" dataDir="dummy"/>
</cores>
</solr>
Re: Question on Lots Of cores - How do I know it's working
Posted by vybe3142 <vy...@gmail.com>.
Thanks so much for the answer, and for "JIRA-fying" it.
--
View this message in context: http://lucene.472066.n3.nabble.com/Question-on-Lots-Of-cores-How-do-I-know-it-s-working-tp4099847p4100005.html
Sent from the Solr - User mailing list archive at Nabble.com.
Re: Question on Lots Of cores - How do I know it's working
Posted by Erick Erickson <er...@gmail.com>.
Just send a query for that core I think....
Erick
On Fri, Nov 8, 2013 at 11:14 AM, vybe3142 <vy...@gmail.com> wrote:
> On a related note, ..
> In our application, the cores can get moderately large , and since we
> mostly
> use a subset of them on a roughly LRU basis, the dynamic core loading
> seems
> a good fit. We interact with our solr server via a solrj client.
>
> That said, we do require the capability to access older cores. Is there any
> command we can use to "warm" a large potentially unloaded transient core
> when we foresee updating or querying it in the near future. For instance,
> would a solrj ping command work for this purpose ?
>
>
>
> --
> View this message in context:
> http://lucene.472066.n3.nabble.com/Question-on-Lots-Of-cores-How-do-I-know-it-s-working-tp4099847p4100014.html
> Sent from the Solr - User mailing list archive at Nabble.com.
>
Re: Question on Lots Of cores - How do I know it's working
Posted by vybe3142 <vy...@gmail.com>.
On a related note, ..
In our application, the cores can get moderately large , and since we mostly
use a subset of them on a roughly LRU basis, the dynamic core loading seems
a good fit. We interact with our solr server via a solrj client.
That said, we do require the capability to access older cores. Is there any
command we can use to "warm" a large potentially unloaded transient core
when we foresee updating or querying it in the near future. For instance,
would a solrj ping command work for this purpose ?
--
View this message in context: http://lucene.472066.n3.nabble.com/Question-on-Lots-Of-cores-How-do-I-know-it-s-working-tp4099847p4100014.html
Sent from the Solr - User mailing list archive at Nabble.com.
Re: Question on Lots Of cores - How do I know it's working
Posted by Erick Erickson <er...@gmail.com>.
Hmmm, not really, you have to kind of take it on faith I'm afraid.
You can check the Solr logs and you should see messages about
cores unloading, but that's not very satisfactory.
Actually sounds like a JIRA. See SOLR-5430
On Thu, Nov 7, 2013 at 12:43 PM, Vinay B, <vy...@gmail.com> wrote:
> As I understand it, the "lots of cores" features enables dynamic loading
> and unloading of cores
> This is how I set up my solr.xml for a test where I created more cores than
> the transientCacheSize.
>
> Here is a link to the config in case it doesn't format well via this post.
> https://gist.github.com/anonymous/7358674
>
> Question: How do I know this feature is working i.e. is there something I
> should watch for on the web container log, etc ? When I inspect the solr
> admin GUI, I can see all the cores I created.
>
>
> Thanks,
> VIn
>
>
>
>
>
>
>
> solr.xml
>
> <?xml version="1.0" encoding="UTF-8" ?>
> <solr persistent="true" sharedLib="lib">
> <cores adminPath="/admin/cores" transientCacheSize="3" >
> <core name="mycore_0001" loadOnStartup="false" instanceDir="cores"
> transient="true" dataDir="mycore_0001"/>
>
> <core name="mycore_7430341611573840011" loadOnStartup="false"
> instanceDir="cores" transient="true" dataDir="mycore_7430341611573840011"/>
>
> <core name="mycore_7697631832332862479" loadOnStartup="false"
> instanceDir="cores" transient="true" dataDir="mycore_7697631832332862479"/>
>
> <core name="mycore_7791568344662376737" loadOnStartup="false"
> instanceDir="cores" transient="true" dataDir="mycore_7791568344662376737"/>
>
> <core name="mycore_8169706828529363612" loadOnStartup="false"
> instanceDir="cores" transient="true" dataDir="mycore_8169706828529363612"/>
>
> <core name="dummy" loadOnStartup="true" instanceDir="cores/"
> schema="schema.xml" transient="false" dataDir="dummy"/>
> </cores>
> </solr>
>