You are viewing a plain text version of this content. The canonical link for it is here.
Posted to solr-user@lucene.apache.org by Tiernan OToole <ls...@gmail.com> on 2012/08/28 16:52:17 UTC
Sharing and performance testing question.
Good morning all.
We are working on a project where we will have somewhere north of 10 solr
instances running in different data centers around the world. Each instance
will have the same schemes, but different data.
We have a test system up and running, mostly virtual boxes and amazon
instances, and see have about 40 million records in the system. Anyway, we
now have the problem of performance testing the system, and want to make it
as real world as possible.
To start, we have a list of query types, single words, multiple words,
anded and ored words, some fuzzy tests and the like. We have the original
data we generated the indexes from, now all we need to do is figure the
best way to load test...
Any tips on load testing solr? Ideally we would like caching to not effect
the result as much as possible.
Thanks in advance.
--Tiernan
AW: Sharing and performance testing question.
Posted by Markus Klose <mk...@shi-gmbh.com>.
Hi tiernan
Check out if solrmeter fits your need (http://code.google.com/p/solrmeter/)
Viele Grüße aus Augsburg
Markus Klose
SHI Elektronische Medien GmbH
-----Ursprüngliche Nachricht-----
Von: Tiernan OToole [mailto:lsmartman@gmail.com]
Gesendet: Dienstag, 28. August 2012 16:52
An: solr-user@lucene.apache.org
Betreff: Sharing and performance testing question.
Good morning all.
We are working on a project where we will have somewhere north of 10 solr instances running in different data centers around the world. Each instance will have the same schemes, but different data.
We have a test system up and running, mostly virtual boxes and amazon instances, and see have about 40 million records in the system. Anyway, we now have the problem of performance testing the system, and want to make it as real world as possible.
To start, we have a list of query types, single words, multiple words, anded and ored words, some fuzzy tests and the like. We have the original data we generated the indexes from, now all we need to do is figure the best way to load test...
Any tips on load testing solr? Ideally we would like caching to not effect the result as much as possible.
Thanks in advance.
--Tiernan
Re: Sharing and performance testing question.
Posted by Tiernan OToole <ls...@gmail.com>.
Thanks for the tips! will check out those links and see what i can find!
On Wed, Aug 29, 2012 at 9:44 AM, Alexey Serba <as...@gmail.com> wrote:
> > Any tips on load testing solr? Ideally we would like caching to not
> effect
> > the result as much as possible.
>
> 1. Siege tool
> This is probably the simplest option. You can generate urls.txt file
> and pass it to the tool. You should also capture server performance
> (CPU, memory, qps, etc) using tools like newrelic, zabbix, etc.
>
> 2. SolrMeter
> http://code.google.com/p/solrmeter/
>
> 3. Solr benchmark module (not committed yet)
> You to run complex benchmarks using different algorithms
> * https://issues.apache.org/jira/browse/SOLR-2646
> *
> http://searchhub.org/dev/2011/07/11/benchmarking-the-new-solr-near-realtime-improvements/
>
--
Tiernan O'Toole
blog.lotas-smartman.net
www.geekphotographer.com
www.tiernanotoole.ie
Re: Sharing and performance testing question.
Posted by Alexey Serba <as...@gmail.com>.
> Any tips on load testing solr? Ideally we would like caching to not effect
> the result as much as possible.
1. Siege tool
This is probably the simplest option. You can generate urls.txt file
and pass it to the tool. You should also capture server performance
(CPU, memory, qps, etc) using tools like newrelic, zabbix, etc.
2. SolrMeter
http://code.google.com/p/solrmeter/
3. Solr benchmark module (not committed yet)
You to run complex benchmarks using different algorithms
* https://issues.apache.org/jira/browse/SOLR-2646
* http://searchhub.org/dev/2011/07/11/benchmarking-the-new-solr-near-realtime-improvements/