You are viewing a plain text version of this content. The canonical link for it is here.
Posted to solr-user@lucene.apache.org by Matt Kuiper <ma...@issinc.com> on 2015/03/25 16:26:58 UTC
Solr Monitoring - Stored Stats?
Hello,
I am familiar with the JMX points that Solr exposes to allow for monitoring of statistics like QPS, numdocs, Average Query Time...
I am wondering if there is a way to configure Solr to automatically store the value of these stats over time (for a given time interval), and then allow a user to query a stat over a time range. So for the QPS stat, the query might return a set that includes the QPS value for each hour in the time range specified.
Thanks,
Matt
Re: Solr Monitoring - Stored Stats?
Posted by Upayavira <uv...@odoko.co.uk>.
Have a look at the admin UI, plugins/stats.
I’ve just spent the time to re-implement it in AngularJS, so I know the
functionality is there - twice :-)
You can “watch for changes” - it pulls in a reference XML, and posts
that back to the server, which only reports back changes.
Dunno if that gives you what you are after?
Upayavira
On Thu, Mar 26, 2015, at 03:15 PM, Matt Kuiper wrote:
> Erick, Shawn,
>
> Thanks for your responses. I figured this was the case, just wanted to
> check to be sure.
>
> I have used Zabbix to configure JMX points to monitor over time, but it
> was a bit of work to get configured. We are looking to create a simple
> dashboard of a few stats over time. Looks like the easiest approach will
> be to make an app to make calls for these stats at a regular interval and
> then index results to Solr, and then we will able to query over desired
> time frames...
>
> Thanks,
> Matt
>
> -----Original Message-----
> From: Erick Erickson [mailto:erickerickson@gmail.com]
> Sent: Wednesday, March 25, 2015 10:30 AM
> To: solr-user@lucene.apache.org
> Subject: Re: Solr Monitoring - Stored Stats?
>
> Matt:
>
> Not really. There's a bunch of third-party log analysis tools that give
> much of this information (not everything exposed by JMX of course is in
> the log files though).
>
> Not quite sure whether things like Nagios, Zabbix and the like have this
> kind of stuff built in seems like a natural extension of those kinds of
> tools though....
>
> Not much help here...
> Erick
>
> On Wed, Mar 25, 2015 at 8:26 AM, Matt Kuiper <ma...@issinc.com>
> wrote:
> > Hello,
> >
> > I am familiar with the JMX points that Solr exposes to allow for monitoring of statistics like QPS, numdocs, Average Query Time...
> >
> > I am wondering if there is a way to configure Solr to automatically store the value of these stats over time (for a given time interval), and then allow a user to query a stat over a time range. So for the QPS stat, the query might return a set that includes the QPS value for each hour in the time range specified.
> >
> > Thanks,
> > Matt
> >
> >
RE: Solr Monitoring - Stored Stats?
Posted by Matt Kuiper <ma...@issinc.com>.
Erick, Shawn,
Thanks for your responses. I figured this was the case, just wanted to check to be sure.
I have used Zabbix to configure JMX points to monitor over time, but it was a bit of work to get configured. We are looking to create a simple dashboard of a few stats over time. Looks like the easiest approach will be to make an app to make calls for these stats at a regular interval and then index results to Solr, and then we will able to query over desired time frames...
Thanks,
Matt
-----Original Message-----
From: Erick Erickson [mailto:erickerickson@gmail.com]
Sent: Wednesday, March 25, 2015 10:30 AM
To: solr-user@lucene.apache.org
Subject: Re: Solr Monitoring - Stored Stats?
Matt:
Not really. There's a bunch of third-party log analysis tools that give much of this information (not everything exposed by JMX of course is in the log files though).
Not quite sure whether things like Nagios, Zabbix and the like have this kind of stuff built in seems like a natural extension of those kinds of tools though....
Not much help here...
Erick
On Wed, Mar 25, 2015 at 8:26 AM, Matt Kuiper <ma...@issinc.com> wrote:
> Hello,
>
> I am familiar with the JMX points that Solr exposes to allow for monitoring of statistics like QPS, numdocs, Average Query Time...
>
> I am wondering if there is a way to configure Solr to automatically store the value of these stats over time (for a given time interval), and then allow a user to query a stat over a time range. So for the QPS stat, the query might return a set that includes the QPS value for each hour in the time range specified.
>
> Thanks,
> Matt
>
>
Re: Solr Monitoring - Stored Stats?
Posted by Erick Erickson <er...@gmail.com>.
Matt:
Not really. There's a bunch of third-party log analysis tools that
give much of this information (not everything exposed by JMX of course
is in the log files though).
Not quite sure whether things like Nagios, Zabbix and the like have
this kind of stuff built in seems like a natural extension of those
kinds of tools though....
Not much help here...
Erick
On Wed, Mar 25, 2015 at 8:26 AM, Matt Kuiper <ma...@issinc.com> wrote:
> Hello,
>
> I am familiar with the JMX points that Solr exposes to allow for monitoring of statistics like QPS, numdocs, Average Query Time...
>
> I am wondering if there is a way to configure Solr to automatically store the value of these stats over time (for a given time interval), and then allow a user to query a stat over a time range. So for the QPS stat, the query might return a set that includes the QPS value for each hour in the time range specified.
>
> Thanks,
> Matt
>
>
Re: Solr Monitoring - Stored Stats?
Posted by Shawn Heisey <ap...@elyograg.org>.
On 3/25/2015 9:26 AM, Matt Kuiper wrote:
> I am familiar with the JMX points that Solr exposes to allow for monitoring of statistics like QPS, numdocs, Average Query Time...
>
> I am wondering if there is a way to configure Solr to automatically store the value of these stats over time (for a given time interval), and then allow a user to query a stat over a time range. So for the QPS stat, the query might return a set that includes the QPS value for each hour in the time range specified.
I am reasonably sure that JMX does not have this ability built in, and
Solr does not keep track of each stat over time.
Some of the statistics, in particular the average and percentile
statistics for QTime on a request handler, are relevant across the
entire history of the handler -- so they are valid until the core is
reloaded or Solr restarts.
Thanks,
Shawn
Re: Solr Monitoring - Stored Stats?
Posted by Otis Gospodnetic <ot...@gmail.com>.
Matt,
SPM will give you all that out of the box with alerts, anomaly detection etc. See http://sematext.com/spm
Otis
> On Mar 25, 2015, at 11:26, Matt Kuiper <ma...@issinc.com> wrote:
>
> Hello,
>
> I am familiar with the JMX points that Solr exposes to allow for monitoring of statistics like QPS, numdocs, Average Query Time...
>
> I am wondering if there is a way to configure Solr to automatically store the value of these stats over time (for a given time interval), and then allow a user to query a stat over a time range. So for the QPS stat, the query might return a set that includes the QPS value for each hour in the time range specified.
>
> Thanks,
> Matt
>
>