Monitoring a Storm Cluster

[Dimitris Amaxilatis <d....@gmail.com>]

Hello everyone,

I wanted to ask if there any configuration for a Strom cluster in order 
to get notifications (via mail ?) when a worker node goes down (or the 
connection the zookeeper ? ).

I have been using storm for quite a while and managed to make my 
production topology quite stable but still have some minor craches on 
the worker nodes at some times.

Checking the Storm UI is a solution but does not offer immediate 
notifications by itself.

Thanks!
Dimitris

Re: Monitoring a Storm Cluster

[Otis Gospodnetic <ot...@gmail.com>]

Hi,

Not an open-source solution, but you can get "heartbeat alerts" when your
worker node goes down if you use SPM <http://sematext.com/spm/>.  If that's
the main thing you are after, pick a free plan and you're good to go.

Otis
--
Performance Monitoring * Log Analytics * Search Analytics
Solr & Elasticsearch Support * http://sematext.com/


On Fri, Apr 25, 2014 at 5:07 AM, Dimitris Amaxilatis <d.amaxilatis@gmail.com
> wrote:

> Hello everyone,
>
> I wanted to ask if there any configuration for a Strom cluster in order to
> get notifications (via mail ?) when a worker node goes down (or the
> connection the zookeeper ? ).
>
> I have been using storm for quite a while and managed to make my
> production topology quite stable but still have some minor craches on the
> worker nodes at some times.
>
> Checking the Storm UI is a solution but does not offer immediate
> notifications by itself.
>
> Thanks!
> Dimitris
>

Re: Monitoring a Storm Cluster

[Danijel Schiavuzzi <da...@schiavuzzi.com>]

You could try Monit, it's a process supervisor with additional system
monitoring and alerting features. It can alert you by e-mail on Supervisor
and Nimbus crashes and any other metrics you setup it to monitor. I believe
you could configure it to monitor Storm's Worker processes too.


On Fri, Apr 25, 2014 at 11:07 AM, Dimitris Amaxilatis <
d.amaxilatis@gmail.com> wrote:

> Hello everyone,
>
> I wanted to ask if there any configuration for a Strom cluster in order to
> get notifications (via mail ?) when a worker node goes down (or the
> connection the zookeeper ? ).
>
> I have been using storm for quite a while and managed to make my
> production topology quite stable but still have some minor craches on the
> worker nodes at some times.
>
> Checking the Storm UI is a solution but does not offer immediate
> notifications by itself.
>
> Thanks!
> Dimitris
>



-- 
Danijel Schiavuzzi

E: danijel@schiavuzzi.com
W: www.schiavuzzi.com
T: +385989035562
Skype: danijels7