You are viewing a plain text version of this content. The canonical link for it is here.
Posted to solr-user@lucene.apache.org by Development Team <de...@gmail.com> on 2009/04/15 21:18:49 UTC

SNMP monitoring

Hi everybody,
     How would I set up SNMP monitoring of my Solr server? I've done some
searching of the wiki and Google and have come up with a blank. Any
pointers?

- Daryl.

Re: SNMP monitoring

Posted by Chris Hostetter <ho...@fucit.org>.
:      How would I set up SNMP monitoring of my Solr server? I've done some
: searching of the wiki and Google and have come up with a blank. Any
: pointers?

it depends on what you want to monitor.  if you just want to know what the 
JVM is running, this should be fairly easy...

if you wnat to be able to get Solr specific stats/data your best bet is 
probably to look into ways to access JMX MBeans via SNMP (there seem to be 
some tools out there to do things like this)

http://blogs.sun.com/jmxetc/entry/jmx_vs_snmp
http://www.google.co.uk/search?hl=en&q=jmx+snmp



-Hoss


Re: SNMP monitoring

Posted by Otis Gospodnetic <ot...@yahoo.com>.
Absolutely and thank you in advance!

Otis
--
Sematext -- http://sematext.com/ -- Lucene - Solr - Nutch



----- Original Message ----
> From: Development Team <de...@gmail.com>
> To: solr-dev@lucene.apache.org
> Sent: Thursday, June 18, 2009 6:48:26 AM
> Subject: Re: SNMP monitoring
> 
> Hi devs,
>      A while ago I posted a question to the solr-users list asking about
> SNMP monitoring of Solr. I got one reply suggesting the use of JMX-SNMP
> bridges, but upon researching these I could find a) nothing that seemed
> particularly good, and/or b) none of those that were free/OSS.
>      Since then I've found that deploying Solr in JBoss/Jetty with the
> JBoss-SNMP SAR was the easiest way to get this job done. --But it still
> wasn't "easy".
>      Thus, my question is; would anybody like to me write up a Solr-Wiki
> page on how to expose Solr stats through SNMP? It's a bit involved, and is
> JBoss-specific, however it is a useful feature that other Solr users may
> benefit from. Let me know.
> 
> - Daryl.
> 
> 
> On Wed, Apr 15, 2009 at 3:18 PM, Development Team wrote:
> 
> > Hi everybody,
> >      How would I set up SNMP monitoring of my Solr server? I've done some
> > searching of the wiki and Google and have come up with a blank. Any
> > pointers?
> >
> > - Daryl.
> >


Re: SNMP monitoring

Posted by Chris Hostetter <ho...@fucit.org>.
:      Should we add a sub-bullet to the main page for SNMP under JBoss? Or
: should we rename the document SolrJBossSNMP and put it under ops&prod? I
: want people to be able to come to the main page and find SNMP there.
:      You're right, the doc is written only paying attention to the JBoss
: SNMP-sar. Maybe I could change this... but unfortunately I never tried it
: with any other container (in fact, I don't know of any other service that
: does the same thing that JBoss does).

which is totally fine ... not every doc on the wiki needs to be container 
agnostic, my point was just that i didn't want to misslead the "casual 
reader" who might see SNMP linked to off hte main page and assume it 
will work for them.  JBoss users will see it, and people really interested 
in SNMP will search for it and fine it -- and if those people want to test 
it / expand the docs to provide instructions for additional containers, we 
can worry about updating the docs at that time (migrating JBOss specific 
stuff to hte JBOss page, linking to the SNMP page fro mthe main page, 
etc...)


-Hoss


Re: SNMP monitoring

Posted by Development Team <de...@gmail.com>.
Hi Chris,
     Good points.
     I originally thought of putting it in the JBoss section, however I
thought it was important to stress that SNMP monitoring (which is part of
"operations and production") can be done, with a footnote that it is done
through SNMP. This is where tree-based documents fail us; SNMP/JBoss should
be under ops&prod due to SNMP, but installation&configuration because of
JBoss.
     Should we add a sub-bullet to the main page for SNMP under JBoss? Or
should we rename the document SolrJBossSNMP and put it under ops&prod? I
want people to be able to come to the main page and find SNMP there.
     You're right, the doc is written only paying attention to the JBoss
SNMP-sar. Maybe I could change this... but unfortunately I never tried it
with any other container (in fact, I don't know of any other service that
does the same thing that JBoss does).

Sincerely,

     Daryl.


On Tue, Jul 7, 2009 at 2:32 PM, Chris Hostetter <ho...@fucit.org>wrote:

>
> : So I've added a page on Solr-SNMP monitoring. It can be found here:
> : http://wiki.apache.org/solr/SolrSnmp   Let me know what you think (or
> feel
> : free to edit it).
>
> I really don't know much about SNMP< butsince this seemed to be JBoss
> specific, i removed the link from the front page and put it on the JBoss
> page.
>
> if i missunderstood, then perhaps the doc could be reorganized --
> clarifying which parts are generic for setting up SNMP monitoring, and
> which parts are JBoss specific (or movinghte JBoss specific parts to the
> SolrJBoss page?)
>
>
> -Hoss
>
>

Re: SNMP monitoring

Posted by Chris Hostetter <ho...@fucit.org>.
: So I've added a page on Solr-SNMP monitoring. It can be found here:
: http://wiki.apache.org/solr/SolrSnmp   Let me know what you think (or feel
: free to edit it).

I really don't know much about SNMP< butsince this seemed to be JBoss 
specific, i removed the link from the front page and put it on the JBoss 
page.

if i missunderstood, then perhaps the doc could be reorganized -- 
clarifying which parts are generic for setting up SNMP monitoring, and 
which parts are JBoss specific (or movinghte JBoss specific parts to the 
SolrJBoss page?)


-Hoss


Re: SNMP monitoring

Posted by Development Team <de...@gmail.com>.
So I've added a page on Solr-SNMP monitoring. It can be found here:
http://wiki.apache.org/solr/SolrSnmp   Let me know what you think (or feel
free to edit it).
- Daryl.


On Thu, Jun 18, 2009 at 12:20 PM, Development Team <de...@gmail.com>wrote:

> Two things:
>
> *1) Solr-Wiki or "contrib"?*
>
>      You know what... I've been thinking this over, and although people
> have already expressed interesting in a Solr-wiki page for JBoss-SNMP, I'm
> wondering if this would be better to be included as a "contrib" segment of
> code.      There are pros/cons to each approach. Some things to consider
> are:
>        - If it's in contrib, users have to know to look for it (a wiki page
> telling them about it could solve this).
>        - If it's in contrib, we have a place for the code to live, so we
> could make sure it continues to compile as Solr evolves.
>        - Fully-working SNMP usually requires you have your own *organization
> ID* of some kind, so we could at best have a half-implementation, that
> would not be testable.
>        - Because it requires JBoss in order to run, it won't be testable.
>      Alternatively, I could stick to the wiki-page approach, and just
> include large bits of sample code in the wiki page, or include smaller code
> snippets in the wiki page *and* include a zip of some more substantial
> code. What do you think?
>
> *2) Exposing Solr's CoreContainer*
>
>      Also, on a related note: My method of implementation was to expose the
> solr CoreContainer by sub-classing SolrDispatchFilter and passing the
> container into an MBean (essentially). I only did this because I had to, and
> I would think a cleaner way to do it would be for Solr to provide a clean
> way of accessing the protected "cores" object in the SolrDispatchFilter.
>      Is it possible to get the CoreContainer without resorting to such
> tricks? (According to my research, it isn't, but I haven't read all of
> Solr's code yet.)
>      And if not, is it possible to have Solr changed so that it can expose
> the CoreContainer?
>
> Let me know,
>
>      Daryl.
>
>
> On Thu, Jun 18, 2009 at 6:48 AM, Development Team <de...@gmail.com>wrote:
>
>> Hi devs,
>>      A while ago I posted a question to the solr-users list asking about
>> SNMP monitoring of Solr. I got one reply suggesting the use of JMX-SNMP
>> bridges, but upon researching these I could find a) nothing that seemed
>> particularly good, and/or b) none of those that were free/OSS.
>>      Since then I've found that deploying Solr in JBoss/Jetty with the
>> JBoss-SNMP SAR was the easiest way to get this job done. --But it still
>> wasn't "easy".
>>      Thus, my question is; would anybody like to me write up a Solr-Wiki
>> page on how to expose Solr stats through SNMP? It's a bit involved, and is
>> JBoss-specific, however it is a useful feature that other Solr users may
>> benefit from. Let me know.
>>
>> - Daryl.
>>
>>
>> On Wed, Apr 15, 2009 at 3:18 PM, Development Team <de...@gmail.com>wrote:
>>
>>> Hi everybody,
>>>      How would I set up SNMP monitoring of my Solr server? I've done some
>>> searching of the wiki and Google and have come up with a blank. Any
>>> pointers?
>>>
>>> - Daryl.
>>>
>>
>>
>

Re: SNMP monitoring

Posted by Development Team <de...@gmail.com>.
Two things:

*1) Solr-Wiki or "contrib"?*

     You know what... I've been thinking this over, and although people have
already expressed interesting in a Solr-wiki page for JBoss-SNMP, I'm
wondering if this would be better to be included as a "contrib" segment of
code.     There are pros/cons to each approach. Some things to consider are:
       - If it's in contrib, users have to know to look for it (a wiki page
telling them about it could solve this).
       - If it's in contrib, we have a place for the code to live, so we
could make sure it continues to compile as Solr evolves.
       - Fully-working SNMP usually requires you have your own *organization
ID* of some kind, so we could at best have a half-implementation, that would
not be testable.
       - Because it requires JBoss in order to run, it won't be testable.
     Alternatively, I could stick to the wiki-page approach, and just
include large bits of sample code in the wiki page, or include smaller code
snippets in the wiki page *and* include a zip of some more substantial code.
What do you think?

*2) Exposing Solr's CoreContainer*

     Also, on a related note: My method of implementation was to expose the
solr CoreContainer by sub-classing SolrDispatchFilter and passing the
container into an MBean (essentially). I only did this because I had to, and
I would think a cleaner way to do it would be for Solr to provide a clean
way of accessing the protected "cores" object in the SolrDispatchFilter.
     Is it possible to get the CoreContainer without resorting to such
tricks? (According to my research, it isn't, but I haven't read all of
Solr's code yet.)
     And if not, is it possible to have Solr changed so that it can expose
the CoreContainer?

Let me know,

     Daryl.


On Thu, Jun 18, 2009 at 6:48 AM, Development Team <de...@gmail.com>wrote:

> Hi devs,
>      A while ago I posted a question to the solr-users list asking about
> SNMP monitoring of Solr. I got one reply suggesting the use of JMX-SNMP
> bridges, but upon researching these I could find a) nothing that seemed
> particularly good, and/or b) none of those that were free/OSS.
>      Since then I've found that deploying Solr in JBoss/Jetty with the
> JBoss-SNMP SAR was the easiest way to get this job done. --But it still
> wasn't "easy".
>      Thus, my question is; would anybody like to me write up a Solr-Wiki
> page on how to expose Solr stats through SNMP? It's a bit involved, and is
> JBoss-specific, however it is a useful feature that other Solr users may
> benefit from. Let me know.
>
> - Daryl.
>
>
> On Wed, Apr 15, 2009 at 3:18 PM, Development Team <de...@gmail.com>wrote:
>
>> Hi everybody,
>>      How would I set up SNMP monitoring of my Solr server? I've done some
>> searching of the wiki and Google and have come up with a blank. Any
>> pointers?
>>
>> - Daryl.
>>
>
>

Re: SNMP monitoring

Posted by Shalin Shekhar Mangar <sh...@gmail.com>.
On Thu, Jun 18, 2009 at 4:18 PM, Development Team <de...@gmail.com>wrote:

> Hi devs,
>     A while ago I posted a question to the solr-users list asking about
> SNMP monitoring of Solr. I got one reply suggesting the use of JMX-SNMP
> bridges, but upon researching these I could find a) nothing that seemed
> particularly good, and/or b) none of those that were free/OSS.
>     Since then I've found that deploying Solr in JBoss/Jetty with the
> JBoss-SNMP SAR was the easiest way to get this job done. --But it still
> wasn't "easy".
>     Thus, my question is; would anybody like to me write up a Solr-Wiki
> page on how to expose Solr stats through SNMP? It's a bit involved, and is
> JBoss-specific, however it is a useful feature that other Solr users may
> benefit from. Let me know.
>

+1

Definitely, please do so!

-- 
Regards,
Shalin Shekhar Mangar.

Re: SNMP monitoring

Posted by Development Team <de...@gmail.com>.
Hi devs,
     A while ago I posted a question to the solr-users list asking about
SNMP monitoring of Solr. I got one reply suggesting the use of JMX-SNMP
bridges, but upon researching these I could find a) nothing that seemed
particularly good, and/or b) none of those that were free/OSS.
     Since then I've found that deploying Solr in JBoss/Jetty with the
JBoss-SNMP SAR was the easiest way to get this job done. --But it still
wasn't "easy".
     Thus, my question is; would anybody like to me write up a Solr-Wiki
page on how to expose Solr stats through SNMP? It's a bit involved, and is
JBoss-specific, however it is a useful feature that other Solr users may
benefit from. Let me know.

- Daryl.


On Wed, Apr 15, 2009 at 3:18 PM, Development Team <de...@gmail.com>wrote:

> Hi everybody,
>      How would I set up SNMP monitoring of my Solr server? I've done some
> searching of the wiki and Google and have come up with a blank. Any
> pointers?
>
> - Daryl.
>