You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-user@hadoop.apache.org by Eric Berkowitz <eb...@roosevelt.edu> on 2011/05/18 13:07:12 UTC
metrics2 ganglia monitoring
We have a 2 rack hadoop cluster with ganglia 3.0 monitoring on all stations both on the native os and within hadoop.
We want to upgrade to the to hadoop 20.203 but with the migration to metrics2 we need help configuring the metrics to continue ganglia monitoring.
All tasktrackers/datanodes push unicast udp upstream to a central gmond daemon on their rack that is then polled by a single gmetad daemon for the cluster.
The current metrics files includes entries similar to the following for all contexts:
Configuration of the "dfs" context for ganglia
dfs.class=org.apache.hadoop.metrics.ganglia.GangliaContext
dfs.period=25
dfs.servers=xsrv1.cs.roosevelt.edu:8670
We have reviewed the package documentation for metrics2 but the examples and explanation are not helpful. Any assistance in the proper configuration of
hadoop-metrics2.properties file to support our current ganglia configuration would be appreciated.
Eric
Re: metrics2 ganglia monitoring
Posted by Luke Lu <ll...@vicaya.com>.
Ganglia plugin is not yet ported to metrics v2 (because Y don't use
Ganglia, see also the discussion links on HADOOP-6728). It shouldn't
be hard to do a port though, as the new sink interface is actually
simpler.
On Wed, May 18, 2011 at 4:07 AM, Eric Berkowitz
<eb...@roosevelt.edu> wrote:
> We have a 2 rack hadoop cluster with ganglia 3.0 monitoring on all stations both on the native os and within hadoop.
>
> We want to upgrade to the to hadoop 20.203 but with the migration to metrics2 we need help configuring the metrics to continue ganglia monitoring.
>
> All tasktrackers/datanodes push unicast udp upstream to a central gmond daemon on their rack that is then polled by a single gmetad daemon for the cluster.
>
> The current metrics files includes entries similar to the following for all contexts:
>
> Configuration of the "dfs" context for ganglia
> dfs.class=org.apache.hadoop.metrics.ganglia.GangliaContext
> dfs.period=25
> dfs.servers=xsrv1.cs.roosevelt.edu:8670
>
> We have reviewed the package documentation for metrics2 but the examples and explanation are not helpful. Any assistance in the proper configuration of
> hadoop-metrics2.properties file to support our current ganglia configuration would be appreciated.
>
> Eric