Performance Monitoring Solution

[Cameron Hurst <wa...@z33k.com>]

I am at the point in my set up that I am happy with how things are being
indexed and my interface is all good to go but what I don't know how to
judge is how often it will be queried and how much resources it needs to
function properly. So what I am looking for is some sort of performance
monitoring solution. I know if I go to the statistics page i can find
the number of queries and the average response time. What I want is a
bit more detailed result, showing how it varies over time. A plot of RAM
usage and possibly disk IO that is due to Solr over time as well.

It is due to my new use of the program but also unsure about my user and
how much they will user my search interface that I need detailed results
of its use. Solutions I have found is New Relic RPM apparently has
support for Solr but you need to use one of their paid packages which I
would like to avoid. The other option I found is LiquidGaze, it says it
is an open source solution for monitoring the handlers and can do a lot
of what I need but has anyone ever used it before and can give it a
rating, good or bad. Is there another solution for this that I have
missed that would be better than the to that I listed?

Re: Performance Monitoring Solution

[Gora Mohanty <go...@mimirtech.com>]

On Mon, Dec 20, 2010 at 3:13 AM, Cameron Hurst <wa...@z33k.com> wrote:
> I am at the point in my set up that I am happy with how things are being
> indexed and my interface is all good to go but what I don't know how to
> judge is how often it will be queried and how much resources it needs to
> function properly. So what I am looking for is some sort of performance
> monitoring solution. I know if I go to the statistics page i can find
> the number of queries and the average response time. What I want is a
> bit more detailed result, showing how it varies over time. A plot of RAM
> usage and possibly disk IO that is due to Solr over time as well.
[...]

Solr exposes statistics through JMX: http://wiki.apache.org/solr/SolrJmx
As described there, you can examine them using jconsole. Nagios also
has several JMX plugins, of which we have successfully used
http://exchange.nagios.org/directory/Plugins/Java-Applications-and-Servers/Syabru-Nagios-JMX-Plugin/details

There are also several open-source JMX clients available, but we did
not find any actively-maintained one with the features that we would
have liked. We have prototyped an in-house JMX application, focused
on Solr, and hope to be able to open-source this soon.

>                             The other option I found is LiquidGaze, it says it
> is an open source solution for monitoring the handlers and can do a lot
> of what I need but has anyone ever used it before and can give it a
> rating, good or bad.
[...]

I presume that you mean LucidGaze. We have been meaning to check
it out, but the person implementing it was running into some issues.

Regards,
Gora