solrconfig.xml settings question

[kenf_nc <ke...@realestate.com>]

In the Wiki and the book by Smiley and Pugh, and in the comments inside the
solrconfig.xml file itself, it always talks about the various settings in
the context of a blended use solr index. By that I mean, it assumes you are
indexing and querying from the same solr instance. However, if I have a
Master-Slave set up I should be able to optimize the Master for indexing
data, and optimize the Slave for querying the data. Does anyone have links
to information that talks about this? I want to index as furiously as
possible into one solr instance without regard to the impact it will have on
queries, and to query on another solr instance that only has to worry about
replication, but not constant add/update/delete/commit activity. I want my
solrconfig settings to be as optimal as possible.

Links, comments, references to previous forum threads, any and all feedback
is appreciated.
Thanks,
Ken
-- 
View this message in context: http://lucene.472066.n3.nabble.com/solrconfig-xml-settings-question-tp2271594p2271594.html
Sent from the Solr - User mailing list archive at Nabble.com.

Re: solrconfig.xml settings question

[Erick Erickson <er...@gmail.com>]

Yep, that's about it. By far the main constraint is memory and the caches
are what eats it up. So by minimizing the caches on the master (since they
are filled by searching) you speed that part up.

By maximizing the cache settings on the servers, you make them go as fast
as possible.

RamBufferSize is irrelevant on the searcher. It governs how much data
is stored in RAM when *indexing* before flushing to disk. This usually
gets to diminishing returns at 128M BTW.

Oh, there is one other thing on the searchers that can really hurt.... to
frequent polling of the master if the master is "furiously indexing" polling
too often can lead to thrashing if the time it takes to autowarm is longer
than the polling interval, which you can only figure out by measuring...

Best
Erick

On Thu, Jan 20, 2011 at 8:34 AM, kenf_nc <ke...@realestate.com> wrote:

>
> Is that it? Of all the strange, esoteric, little understood configuration
> settings available in solrconfig.xml, the only thing that affects Index
> Speed vs Query Speed is turning on/off the Query Cache and RamBufferSize?
> And for the latter, why wouldn't RamBufferSize be the same for both...that
> is, as high as you can make it?
> --
> View this message in context:
> http://lucene.472066.n3.nabble.com/solrconfig-xml-settings-question-tp2271594p2294668.html
> Sent from the Solr - User mailing list archive at Nabble.com.
>

Re: solrconfig.xml settings question

[kenf_nc <ke...@realestate.com>]

Is that it? Of all the strange, esoteric, little understood configuration
settings available in solrconfig.xml, the only thing that affects Index
Speed vs Query Speed is turning on/off the Query Cache and RamBufferSize?
And for the latter, why wouldn't RamBufferSize be the same for both...that
is, as high as you can make it?
-- 
View this message in context: http://lucene.472066.n3.nabble.com/solrconfig-xml-settings-question-tp2271594p2294668.html
Sent from the Solr - User mailing list archive at Nabble.com.

Re: solrconfig.xml settings question

[Ahmet Arslan <io...@yahoo.com>]

> In the Wiki and the book by Smiley and Pugh, and in the
> comments inside the
> solrconfig.xml file itself, it always talks about the
> various settings in
> the context of a blended use solr index. By that I mean, it
> assumes you are
> indexing and querying from the same solr instance. However,
> if I have a
> Master-Slave set up I should be able to optimize the Master
> for indexing
> data, and optimize the Slave for querying the data. Does
> anyone have links
> to information that talks about this? I want to index as
> furiously as
> possible into one solr instance without regard to the
> impact it will have on
> queries, and to query on another solr instance that only
> has to worry about
> replication, but not constant add/update/delete/commit
> activity. I want my
> solrconfig settings to be as optimal as possible.
> 
> Links, comments, references to previous forum threads, any
> and all feedback
> is appreciated.

Besides caches described here http://search-lucene.com/m/DBdghoZPh01 , ramBufferSizeMB can be different on slave and master.