You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-user@hadoop.apache.org by Manu S <ma...@gmail.com> on 2012/05/11 07:31:40 UTC
Monitoring Hadoop Cluster
Hi All,
Which is the best monitoring tool for Hadoop cluster monitoring? Ganglia or
Nagios?
Thanks,
Manu S
Re: Monitoring Hadoop Cluster
Posted by Stu Teasdale <st...@drogna.org.uk>.
I've helped out linking hadoop to munin using jmx querying in the past,
there's a writeup at:
http://www.cs.huji.ac.il/wikis/MediaWiki/lawa/index.php/Munin_for_Hadoop
Stu
On Fri, May 11, 2012 at 02:15:16AM -0700, Lance Norskog wrote:
> zabbix does monitoring, archiving and graphing, and alerts.
>
> It has a JMX bean monitor system. If Hadoop has these, or you can add
> them easily, you have a great monitor. Also, check out 'Starfish'.
> It's a little old, but I got it running and it was really cool.
>
> On Thu, May 10, 2012 at 11:24 PM, Manu S <ma...@gmail.com> wrote:
> > Thanks a lot Junyong
> >
> > On Fri, May 11, 2012 at 11:15 AM, JunYong Li <li...@gmail.com> wrote:
> >
> >> Each has its own merits.
> >> http://developer.yahoo.com/hadoop/tutorial/module7.html#monitoring
> >>
> >> 2012/5/11 Manu S <ma...@gmail.com>
> >>
> >> > Hi All,
> >> >
> >> > Which is the best monitoring tool for Hadoop cluster monitoring? Ganglia
> >> or
> >> > Nagios?
> >> >
> >> > Thanks,
> >> > Manu S
> >> >
> >>
> >>
> >>
> >> --
> >> Regards
> >> Junyong
> >>
>
>
>
> --
> Lance Norskog
> goksron@gmail.com
--
>From the prompt of Stu Teasdale
Happiness is a hard disk.
Re: Monitoring Hadoop Cluster
Posted by Lance Norskog <go...@gmail.com>.
zabbix does monitoring, archiving and graphing, and alerts.
It has a JMX bean monitor system. If Hadoop has these, or you can add
them easily, you have a great monitor. Also, check out 'Starfish'.
It's a little old, but I got it running and it was really cool.
On Thu, May 10, 2012 at 11:24 PM, Manu S <ma...@gmail.com> wrote:
> Thanks a lot Junyong
>
> On Fri, May 11, 2012 at 11:15 AM, JunYong Li <li...@gmail.com> wrote:
>
>> Each has its own merits.
>> http://developer.yahoo.com/hadoop/tutorial/module7.html#monitoring
>>
>> 2012/5/11 Manu S <ma...@gmail.com>
>>
>> > Hi All,
>> >
>> > Which is the best monitoring tool for Hadoop cluster monitoring? Ganglia
>> or
>> > Nagios?
>> >
>> > Thanks,
>> > Manu S
>> >
>>
>>
>>
>> --
>> Regards
>> Junyong
>>
--
Lance Norskog
goksron@gmail.com
Re: Monitoring Hadoop Cluster
Posted by Manu S <ma...@gmail.com>.
Thanks a lot Junyong
On Fri, May 11, 2012 at 11:15 AM, JunYong Li <li...@gmail.com> wrote:
> Each has its own merits.
> http://developer.yahoo.com/hadoop/tutorial/module7.html#monitoring
>
> 2012/5/11 Manu S <ma...@gmail.com>
>
> > Hi All,
> >
> > Which is the best monitoring tool for Hadoop cluster monitoring? Ganglia
> or
> > Nagios?
> >
> > Thanks,
> > Manu S
> >
>
>
>
> --
> Regards
> Junyong
>
Re: Monitoring Hadoop Cluster
Posted by JunYong Li <li...@gmail.com>.
Each has its own merits.
http://developer.yahoo.com/hadoop/tutorial/module7.html#monitoring
2012/5/11 Manu S <ma...@gmail.com>
> Hi All,
>
> Which is the best monitoring tool for Hadoop cluster monitoring? Ganglia or
> Nagios?
>
> Thanks,
> Manu S
>
--
Regards
Junyong
Re: Monitoring Hadoop Cluster
Posted by Manu S <ma...@gmail.com>.
Cool :) Thanks for your quick reply.
On Fri, May 11, 2012 at 11:07 AM, v v <v...@vigith.com> wrote:
> Ganglia won't send alerts, but it is a very good monitoring tool for
> viewing the metrics (hadoop has support for emitting metrics to
> ganglia).
>
> If you need alerting (eg, dfs namespace > 90%) then you will have to
> use nagios or something similar to it.
>
> I would say, you need both.
>
> On May 11, 10:31 am, Manu S <ma...@gmail.com> wrote:
> > Hi All,
> >
> > Which is the best monitoring tool for Hadoop cluster monitoring? Ganglia
> or
> > Nagios?
> >
> > Thanks,
> > Manu S
>