Performance Tuning in Solr

[Mugeesh Husain <mu...@gmail.com>]

For the large amount of data set, going to implement many shard and many
node.

I am unaware of performance tuning in solr ? how people use or check solr
performance ?

Is there any open source tool   or i should create my own for this and how ?


Thanks
Mugeesh




--
View this message in context: http://lucene.472066.n3.nabble.com/Performance-Tuning-in-Solr-tp4304878.html
Sent from the Solr - User mailing list archive at Nabble.com.

Re: Performance Tuning in Solr

[Shawn Heisey <ap...@elyograg.org>]

On 11/7/2016 6:27 AM, Mugeesh Husain wrote:
> For the large amount of data set, going to implement many shard and
> many node. I am unaware of performance tuning in solr ? how people use
> or check solr performance ? Is there any open source tool or i should
> create my own for this and how ? 

See this article:

https://lucidworks.com/blog/sizing-hardware-in-the-abstract-why-we-dont-have-a-definitive-answer/

Pretty much the same thing applies to performance measuring and tuning. 
There are no easy answers.  Solr does collect and display some
statistics on the QTime for requests on each handler, but this is only
one metric, others may need attention.

What you consider to be large may be very small to someone else, and
providing generic answers is nearly impossible.

For the most part, measuring consists of setting up the system and
hitting it with a normal query load.  If the handler statistics look
acceptable and queries complete in a satisfactory amount of time, you're
good.

Most "tuning" of Solr consists of making sure there is enough memory for
good disk caching.  This is memory above and beyond the Java heap.  I've
collected my thoughts on this subject here:

https://wiki.apache.org/solr/SolrPerformanceProblems

For extreme scalability, sometimes adjusting the configuration (mostly
the operating system, but sometimes Solr) is necessary, but it is
generally well-tuned out of the box for most workloads.  It is difficult
to anticipate what problems you will run into on your particular system.

Thanks,
Shawn