You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-user@hadoop.apache.org by Jason Venner <ja...@attributor.com> on 2008/02/21 19:28:49 UTC

Question on metrics via ganglia

We have modified my metrics file, distributed it and restarted our 
cluster. We have gmond running on the nodes, and a machine on the vlan 
with gmetad running.
We have statistics for the machines in the web ui, and our statistics 
reported by the gmetric program are present. We don't see any hadoop 
reporting.

Clearly we have something basic wrong in our understanding of how to set 
this up.

# Configuration of the "dfs" context for null
# dfs.class=org.apache.hadoop.metrics.spi.NullContext

# Configuration of the "dfs" context for file
#dfs.class=org.apache.hadoop.metrics.file.FileContext
#dfs.period=10
#dfs.fileName=/tmp/dfsmetrics.log

# Configuration of the "dfs" context for ganglia
dfs.class=org.apache.hadoop.metrics.ganglia.GangliaContext
dfs.period=10
dfs.servers=localhost:8649


# Configuration of the "mapred" context for null
# mapred.class=org.apache.hadoop.metrics.spi.NullContext

# Configuration of the "mapred" context for file
#mapred.class=org.apache.hadoop.metrics.file.FileContext
#mapred.period=10
#mapred.fileName=/tmp/mrmetrics.log

# Configuration of the "mapred" context for ganglia
mapred.class=org.apache.hadoop.metrics.ganglia.GangliaContext
mapred.period=10
mapred.servers=localhost:8649


# Configuration of the "jvm" context for null
# jvm.class=org.apache.hadoop.metrics.spi.NullContext

# Configuration of the "jvm" context for file
#jvm.class=org.apache.hadoop.metrics.file.FileContext
#jvm.period=10
#jvm.fileName=/tmp/jvmmetrics.log

# Configuration of the "jvm" context for ganglia
jvm.class=org.apache.hadoop.metrics.ganglia.GangliaContext
jvm.period=10
jvm.servers=localhost:8649


-- 
Jason Venner
Attributor - Publish with Confidence <http://www.attributor.com/>
Attributor is hiring Hadoop Wranglers, contact if interested

Re: Question on metrics via ganglia solved

Posted by Jason Venner <ja...@attributor.com>.
Instead of localhost, in the servers block, we now put the machine that 
has gmetad running.

dfs.class=org.apache.hadoop.metrics.ganglia.GangliaContext
dfs.period=10
dfs.servers=GMETAD_HOST:8649


Jason Venner wrote:
> Well, with the metrics file changed to perform file based logging, 
> metrics do appear.
> On digging into the GangliaContext source, it looks like it is using 
> udp for reporting, and we modified the gmond.conf to receive via udp 
> as well as tcp. netstat -a -p shows gmond monitoring 8649 for both tcp 
> and udp.
> Still nothing visible via the ganglia ui and no rrd file for anything 
> hadoop related.
>
> Jason Venner wrote:
>> We have modified my metrics file, distributed it and restarted our 
>> cluster. We have gmond running on the nodes, and a machine on the 
>> vlan with gmetad running.
>> We have statistics for the machines in the web ui, and our statistics 
>> reported by the gmetric program are present. We don't see any hadoop 
>> reporting.
>>
>> Clearly we have something basic wrong in our understanding of how to 
>> set this up.
>>
>> # Configuration of the "dfs" context for null
>> # dfs.class=org.apache.hadoop.metrics.spi.NullContext
>>
>> # Configuration of the "dfs" context for file
>> #dfs.class=org.apache.hadoop.metrics.file.FileContext
>> #dfs.period=10
>> #dfs.fileName=/tmp/dfsmetrics.log
>>
>> # Configuration of the "dfs" context for ganglia
>> dfs.class=org.apache.hadoop.metrics.ganglia.GangliaContext
>> dfs.period=10
>> dfs.servers=localhost:8649
>>
>>
>> # Configuration of the "mapred" context for null
>> # mapred.class=org.apache.hadoop.metrics.spi.NullContext
>>
>> # Configuration of the "mapred" context for file
>> #mapred.class=org.apache.hadoop.metrics.file.FileContext
>> #mapred.period=10
>> #mapred.fileName=/tmp/mrmetrics.log
>>
>> # Configuration of the "mapred" context for ganglia
>> mapred.class=org.apache.hadoop.metrics.ganglia.GangliaContext
>> mapred.period=10
>> mapred.servers=localhost:8649
>>
>>
>> # Configuration of the "jvm" context for null
>> # jvm.class=org.apache.hadoop.metrics.spi.NullContext
>>
>> # Configuration of the "jvm" context for file
>> #jvm.class=org.apache.hadoop.metrics.file.FileContext
>> #jvm.period=10
>> #jvm.fileName=/tmp/jvmmetrics.log
>>
>> # Configuration of the "jvm" context for ganglia
>> jvm.class=org.apache.hadoop.metrics.ganglia.GangliaContext
>> jvm.period=10
>> jvm.servers=localhost:8649
>>
>>
-- 
Jason Venner
Attributor - Publish with Confidence <http://www.attributor.com/>
Attributor is hiring Hadoop Wranglers, contact if interested

Re: Question on metrics via ganglia

Posted by Jason Venner <ja...@attributor.com>.
Well, with the metrics file changed to perform file based logging, 
metrics do appear.
On digging into the GangliaContext source, it looks like it is using udp 
for reporting, and we modified the gmond.conf to receive via udp as well 
as tcp. netstat -a -p shows gmond monitoring 8649 for both tcp and udp.
Still nothing visible via the ganglia ui and no rrd file for anything 
hadoop related.

Jason Venner wrote:
> We have modified my metrics file, distributed it and restarted our 
> cluster. We have gmond running on the nodes, and a machine on the vlan 
> with gmetad running.
> We have statistics for the machines in the web ui, and our statistics 
> reported by the gmetric program are present. We don't see any hadoop 
> reporting.
>
> Clearly we have something basic wrong in our understanding of how to 
> set this up.
>
> # Configuration of the "dfs" context for null
> # dfs.class=org.apache.hadoop.metrics.spi.NullContext
>
> # Configuration of the "dfs" context for file
> #dfs.class=org.apache.hadoop.metrics.file.FileContext
> #dfs.period=10
> #dfs.fileName=/tmp/dfsmetrics.log
>
> # Configuration of the "dfs" context for ganglia
> dfs.class=org.apache.hadoop.metrics.ganglia.GangliaContext
> dfs.period=10
> dfs.servers=localhost:8649
>
>
> # Configuration of the "mapred" context for null
> # mapred.class=org.apache.hadoop.metrics.spi.NullContext
>
> # Configuration of the "mapred" context for file
> #mapred.class=org.apache.hadoop.metrics.file.FileContext
> #mapred.period=10
> #mapred.fileName=/tmp/mrmetrics.log
>
> # Configuration of the "mapred" context for ganglia
> mapred.class=org.apache.hadoop.metrics.ganglia.GangliaContext
> mapred.period=10
> mapred.servers=localhost:8649
>
>
> # Configuration of the "jvm" context for null
> # jvm.class=org.apache.hadoop.metrics.spi.NullContext
>
> # Configuration of the "jvm" context for file
> #jvm.class=org.apache.hadoop.metrics.file.FileContext
> #jvm.period=10
> #jvm.fileName=/tmp/jvmmetrics.log
>
> # Configuration of the "jvm" context for ganglia
> jvm.class=org.apache.hadoop.metrics.ganglia.GangliaContext
> jvm.period=10
> jvm.servers=localhost:8649
>
>