You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-user@hadoop.apache.org by Larry Compton <la...@gmail.com> on 2010/03/22 20:55:46 UTC
Ganglia Configuration
When Hadoop is properly configured to use Ganglia, do you see additional
entries in the Ganglia XML output? We've configured Hadoop to send metrics
to Ganglia, but we're not seeing additional information when we run "telnet
localhost 8649". The only configuration change we made was to update
"hadoop-metrics.properties" per the instructions in...
http://wiki.apache.org/hadoop/GangliaMetrics
Do you also have to make changes in "gmond.conf"? If so, what changes are
necessary?
- Cloudera Hadoop Distribution hadoop-0.20.1+169.56
- Ganglia 3.1.2
- Ubuntu 9.10
Here is our "hadoop-metrics.properties" file...
# Configuration of the "dfs" context for null
#dfs.class=org.apache.hadoop.metrics.spi.NullContext
# Configuration of the "dfs" context for file
#dfs.class=org.apache.hadoop.metrics.file.FileContext
#dfs.period=10
#dfs.fileName=/tmp/dfsmetrics.log
# Configuration of the "dfs" context for ganglia
# Pick one: Ganglia 3.0 (former) or Ganglia 3.1 (latter)
# dfs.class=org.apache.hadoop.metrics.ganglia.GangliaContext
dfs.class=org.apache.hadoop.metrics.ganglia.GangliaContext31
dfs.period=10
dfs.servers=localhost:8649
# Configuration of the "mapred" context for null
#mapred.class=org.apache.hadoop.metrics.spi.NullContext
# Configuration of the "mapred" context for file
#mapred.class=org.apache.hadoop.metrics.file.FileContext
#mapred.period=10
#mapred.fileName=/tmp/mrmetrics.log
# Configuration of the "mapred" context for ganglia
# Pick one: Ganglia 3.0 (former) or Ganglia 3.1 (latter)
# mapred.class=org.apache.hadoop.metrics.ganglia.GangliaContext
mapred.class=org.apache.hadoop.metrics.ganglia.GangliaContext31
mapred.period=10
mapred.servers=localhost:8649
# Configuration of the "jvm" context for null
#jvm.class=org.apache.hadoop.metrics.spi.NullContext
# Configuration of the "jvm" context for file
#jvm.class=org.apache.hadoop.metrics.file.FileContext
#jvm.period=10
#jvm.fileName=/tmp/jvmmetrics.log
# Configuration of the "jvm" context for ganglia
jvm.class=org.apache.hadoop.metrics.ganglia.GangliaContext
jvm.period=10
jvm.servers=localhost:8649
# Configuration of the "rpc" context for ganglia
#rpc.class=org.apache.hadoop.metrics.ganglia.GangliaContext
#rpc.period=10
#rpc.servers=localhost:8649
Re: Ganglia Configuration
Posted by Larry Compton <la...@gmail.com>.
I figured it out. The IP address of the host running "gmetad" didn't work,
but specifying the value found in the "udp_send_channel" block in
"gmond.conf" worked (239.2.11.71), as is indeed specified in
http://wiki.apache.org/hadoop/GangliaMetrics. Here's the "udp_send_channel"
block...
udp_send_channel {
mcast_join = 239.2.11.71
port = 8649
ttl = 1
}
And for those who have similar problems getting this to work, here is a
sample of the sort of output to expect from Ganglia if this is working
correctly. A significant number of additional entries will appear in the XML
output...
<METRIC NAME="jvm.metrics.threadsRunnable" VAL="6" TYPE="int32" UNITS=""
TN="0" TMAX="60" DMAX="0" SLOPE="both">
<EXTRA_DATA>
<EXTRA_ELEMENT NAME="GROUP" VAL="jvm.metrics"/>
</EXTRA_DATA>
</METRIC>
<METRIC NAME="rpc.metrics.mkdirs_num_ops" VAL="1" TYPE="int32" UNITS=""
TN="0" TMAX="60" DMAX="0" SLOPE="both">
<EXTRA_DATA>
<EXTRA_ELEMENT NAME="GROUP" VAL="rpc.metrics"/>
</EXTRA_DATA>
</METRIC>
<METRIC NAME="mapred.jobtracker.reduces_completed" VAL="0" TYPE="int32"
UNITS="" TN="3" TMAX="60" DMAX="0" SLOPE="both">
<EXTRA_DATA>
<EXTRA_ELEMENT NAME="GROUP" VAL="mapred.jobtracker"/>
</EXTRA_DATA>
</METRIC>
On Mon, Mar 22, 2010 at 4:07 PM, Nathan Harkenrider <
nathan.harkenrider@gmail.com> wrote:
> Try changing dfs.servers to point to the IP of the machine running the
> gmetad daemon.
>
> Example,
>
> dfs.servers=<ip of host running gmetad>:8649
>
> Regards,
>
> Nathan Harkenrider
>
> On Mon, Mar 22, 2010 at 12:55 PM, Larry Compton
> <la...@gmail.com>wrote:
>
> > When Hadoop is properly configured to use Ganglia, do you see additional
> > entries in the Ganglia XML output? We've configured Hadoop to send
> metrics
> > to Ganglia, but we're not seeing additional information when we run
> "telnet
> > localhost 8649". The only configuration change we made was to update
> > "hadoop-metrics.properties" per the instructions in...
> >
> > http://wiki.apache.org/hadoop/GangliaMetrics
> >
> > Do you also have to make changes in "gmond.conf"? If so, what changes are
> > necessary?
> >
> > - Cloudera Hadoop Distribution hadoop-0.20.1+169.56
> > - Ganglia 3.1.2
> > - Ubuntu 9.10
> >
> > Here is our "hadoop-metrics.properties" file...
> >
> > # Configuration of the "dfs" context for null
> > #dfs.class=org.apache.hadoop.metrics.spi.NullContext
> >
> > # Configuration of the "dfs" context for file
> > #dfs.class=org.apache.hadoop.metrics.file.FileContext
> > #dfs.period=10
> > #dfs.fileName=/tmp/dfsmetrics.log
> >
> > # Configuration of the "dfs" context for ganglia
> > # Pick one: Ganglia 3.0 (former) or Ganglia 3.1 (latter)
> > # dfs.class=org.apache.hadoop.metrics.ganglia.GangliaContext
> > dfs.class=org.apache.hadoop.metrics.ganglia.GangliaContext31
> > dfs.period=10
> > dfs.servers=localhost:8649
> >
> >
> > # Configuration of the "mapred" context for null
> > #mapred.class=org.apache.hadoop.metrics.spi.NullContext
> >
> > # Configuration of the "mapred" context for file
> > #mapred.class=org.apache.hadoop.metrics.file.FileContext
> > #mapred.period=10
> > #mapred.fileName=/tmp/mrmetrics.log
> >
> > # Configuration of the "mapred" context for ganglia
> > # Pick one: Ganglia 3.0 (former) or Ganglia 3.1 (latter)
> > # mapred.class=org.apache.hadoop.metrics.ganglia.GangliaContext
> > mapred.class=org.apache.hadoop.metrics.ganglia.GangliaContext31
> > mapred.period=10
> > mapred.servers=localhost:8649
> >
> >
> > # Configuration of the "jvm" context for null
> > #jvm.class=org.apache.hadoop.metrics.spi.NullContext
> >
> > # Configuration of the "jvm" context for file
> > #jvm.class=org.apache.hadoop.metrics.file.FileContext
> > #jvm.period=10
> > #jvm.fileName=/tmp/jvmmetrics.log
> >
> > # Configuration of the "jvm" context for ganglia
> > jvm.class=org.apache.hadoop.metrics.ganglia.GangliaContext
> > jvm.period=10
> > jvm.servers=localhost:8649
> >
> > # Configuration of the "rpc" context for ganglia
> > #rpc.class=org.apache.hadoop.metrics.ganglia.GangliaContext
> > #rpc.period=10
> > #rpc.servers=localhost:8649
> >
>
--
Larry Compton
SRA International
240.373.5312 (APL)
443.742.2762 (cell)
Re: Ganglia Configuration
Posted by Nathan Harkenrider <na...@gmail.com>.
Try changing dfs.servers to point to the IP of the machine running the
gmetad daemon.
Example,
dfs.servers=<ip of host running gmetad>:8649
Regards,
Nathan Harkenrider
On Mon, Mar 22, 2010 at 12:55 PM, Larry Compton
<la...@gmail.com>wrote:
> When Hadoop is properly configured to use Ganglia, do you see additional
> entries in the Ganglia XML output? We've configured Hadoop to send metrics
> to Ganglia, but we're not seeing additional information when we run "telnet
> localhost 8649". The only configuration change we made was to update
> "hadoop-metrics.properties" per the instructions in...
>
> http://wiki.apache.org/hadoop/GangliaMetrics
>
> Do you also have to make changes in "gmond.conf"? If so, what changes are
> necessary?
>
> - Cloudera Hadoop Distribution hadoop-0.20.1+169.56
> - Ganglia 3.1.2
> - Ubuntu 9.10
>
> Here is our "hadoop-metrics.properties" file...
>
> # Configuration of the "dfs" context for null
> #dfs.class=org.apache.hadoop.metrics.spi.NullContext
>
> # Configuration of the "dfs" context for file
> #dfs.class=org.apache.hadoop.metrics.file.FileContext
> #dfs.period=10
> #dfs.fileName=/tmp/dfsmetrics.log
>
> # Configuration of the "dfs" context for ganglia
> # Pick one: Ganglia 3.0 (former) or Ganglia 3.1 (latter)
> # dfs.class=org.apache.hadoop.metrics.ganglia.GangliaContext
> dfs.class=org.apache.hadoop.metrics.ganglia.GangliaContext31
> dfs.period=10
> dfs.servers=localhost:8649
>
>
> # Configuration of the "mapred" context for null
> #mapred.class=org.apache.hadoop.metrics.spi.NullContext
>
> # Configuration of the "mapred" context for file
> #mapred.class=org.apache.hadoop.metrics.file.FileContext
> #mapred.period=10
> #mapred.fileName=/tmp/mrmetrics.log
>
> # Configuration of the "mapred" context for ganglia
> # Pick one: Ganglia 3.0 (former) or Ganglia 3.1 (latter)
> # mapred.class=org.apache.hadoop.metrics.ganglia.GangliaContext
> mapred.class=org.apache.hadoop.metrics.ganglia.GangliaContext31
> mapred.period=10
> mapred.servers=localhost:8649
>
>
> # Configuration of the "jvm" context for null
> #jvm.class=org.apache.hadoop.metrics.spi.NullContext
>
> # Configuration of the "jvm" context for file
> #jvm.class=org.apache.hadoop.metrics.file.FileContext
> #jvm.period=10
> #jvm.fileName=/tmp/jvmmetrics.log
>
> # Configuration of the "jvm" context for ganglia
> jvm.class=org.apache.hadoop.metrics.ganglia.GangliaContext
> jvm.period=10
> jvm.servers=localhost:8649
>
> # Configuration of the "rpc" context for ganglia
> #rpc.class=org.apache.hadoop.metrics.ganglia.GangliaContext
> #rpc.period=10
> #rpc.servers=localhost:8649
>