You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@flume.apache.org by ch huang <ju...@gmail.com> on 2013/11/01 07:33:35 UTC
how can i monitor flume though ganglia?
hi,all:
i read the flume user manual,it says "Flume can also report these
metrics to Ganglia 3 or Ganglia 3.1 metanodes."
i have hadoop cluster (192.168.11.11/12/13/14/15) ,and ganglia gmetad
installed in 192.168.11.142,also a flume agent installed in
192.168.11.12, and i am confused about the host which flume should
report ,should i write this in flume-env.sh?
JAVA_OPTS="-Xms100m -Xmx200m -Dcom.sun.management.jmxremote
-Dflume.monitoring.type=ganglia -Dflume.monitoring.hosts=192.168.11.142:8651
# ps -ef|grep gmeta
root 11365 1739 0 14:27 pts/3 00:00:00 grep gmeta
nobody 23108 1 6 Oct24 ? 13:16:40 /usr/sbin/gmetad
# netstat -utlpn|grep 23108
tcp 0 0 0.0.0.0:8651 0.0.0.0:*
LISTEN 23108/gmetad
tcp 0 0 0.0.0.0:8652 0.0.0.0:*
LISTEN 23108/gmetad
Re: how can i monitor flume though ganglia?
Posted by Ashish <pa...@gmail.com>.
On Fri, Nov 1, 2013 at 2:22 PM, ch huang <ju...@gmail.com> wrote:
> i am not very clear ,i have only on ganglia gmetad deploy on 11.142
> ,should i still need add comma after 192.168.11.142:8651 ?
No!, It's only needed if you have multiple servers
>
>
> On Fri, Nov 1, 2013 at 3:00 PM, Ashish <pa...@gmail.com> wrote:
>
>> The parameter -Dflume.monitoring.hosts is the comma separated lists of
>> Ganglia server which the Agent should report the Stats to. This is more
>> clear in the javadocs. Shall raise a JIRA to make add this to User Guide
>>
>> You can pass -Dflume.monitoring.type=ganglia -Dflume.monitoring.hosts=
>> 192.168.11.142:8651, when you start the Agent, as specified in User
>> Guide.
>>
>> Let us know if you have further queries.
>>
>>
>>
>> On Fri, Nov 1, 2013 at 12:03 PM, ch huang <ju...@gmail.com> wrote:
>>
>>> hi,all:
>>> i read the flume user manual,it says "Flume can also report
>>> these metrics to Ganglia 3 or Ganglia 3.1 metanodes."
>>>
>>> i have hadoop cluster (192.168.11.11/12/13/14/15) ,and ganglia gmetad
>>> installed in 192.168.11.142,also a flume agent installed in
>>> 192.168.11.12, and i am confused about the host which flume should
>>> report ,should i write this in flume-env.sh?
>>>
>>> JAVA_OPTS="-Xms100m -Xmx200m -Dcom.sun.management.jmxremote
>>> -Dflume.monitoring.type=ganglia -Dflume.monitoring.hosts=
>>> 192.168.11.142:8651
>>>
>>> # ps -ef|grep gmeta
>>> root 11365 1739 0 14:27 pts/3 00:00:00 grep gmeta
>>> nobody 23108 1 6 Oct24 ? 13:16:40 /usr/sbin/gmetad
>>> # netstat -utlpn|grep 23108
>>> tcp 0 0 0.0.0.0:8651 0.0.0.0:*
>>> LISTEN 23108/gmetad
>>> tcp 0 0 0.0.0.0:8652 0.0.0.0:*
>>> LISTEN 23108/gmetad
>>>
>>>
>>
>>
>>
>> --
>> thanks
>> ashish
>>
>> Blog: http://www.ashishpaliwal.com/blog
>> My Photo Galleries: http://www.pbase.com/ashishpaliwal
>>
>
>
--
thanks
ashish
Blog: http://www.ashishpaliwal.com/blog
My Photo Galleries: http://www.pbase.com/ashishpaliwal
Re: how can i monitor flume though ganglia?
Posted by ch huang <ju...@gmail.com>.
i am not very clear ,i have only on ganglia gmetad deploy on 11.142 ,should
i still need add comma after 192.168.11.142:8651 ?
On Fri, Nov 1, 2013 at 3:00 PM, Ashish <pa...@gmail.com> wrote:
> The parameter -Dflume.monitoring.hosts is the comma separated lists of
> Ganglia server which the Agent should report the Stats to. This is more
> clear in the javadocs. Shall raise a JIRA to make add this to User Guide
>
> You can pass -Dflume.monitoring.type=ganglia -Dflume.monitoring.hosts=
> 192.168.11.142:8651, when you start the Agent, as specified in User
> Guide.
>
> Let us know if you have further queries.
>
>
>
> On Fri, Nov 1, 2013 at 12:03 PM, ch huang <ju...@gmail.com> wrote:
>
>> hi,all:
>> i read the flume user manual,it says "Flume can also report these
>> metrics to Ganglia 3 or Ganglia 3.1 metanodes."
>>
>> i have hadoop cluster (192.168.11.11/12/13/14/15) ,and ganglia gmetad
>> installed in 192.168.11.142,also a flume agent installed in
>> 192.168.11.12, and i am confused about the host which flume should
>> report ,should i write this in flume-env.sh?
>>
>> JAVA_OPTS="-Xms100m -Xmx200m -Dcom.sun.management.jmxremote
>> -Dflume.monitoring.type=ganglia -Dflume.monitoring.hosts=
>> 192.168.11.142:8651
>>
>> # ps -ef|grep gmeta
>> root 11365 1739 0 14:27 pts/3 00:00:00 grep gmeta
>> nobody 23108 1 6 Oct24 ? 13:16:40 /usr/sbin/gmetad
>> # netstat -utlpn|grep 23108
>> tcp 0 0 0.0.0.0:8651 0.0.0.0:*
>> LISTEN 23108/gmetad
>> tcp 0 0 0.0.0.0:8652 0.0.0.0:*
>> LISTEN 23108/gmetad
>>
>>
>
>
>
> --
> thanks
> ashish
>
> Blog: http://www.ashishpaliwal.com/blog
> My Photo Galleries: http://www.pbase.com/ashishpaliwal
>
Re: how can i monitor flume though ganglia?
Posted by Ashish <pa...@gmail.com>.
The parameter -Dflume.monitoring.hosts is the comma separated lists of
Ganglia server which the Agent should report the Stats to. This is more
clear in the javadocs. Shall raise a JIRA to make add this to User Guide
You can pass -Dflume.monitoring.type=ganglia -Dflume.monitoring.hosts=
192.168.11.142:8651, when you start the Agent, as specified in User Guide.
Let us know if you have further queries.
On Fri, Nov 1, 2013 at 12:03 PM, ch huang <ju...@gmail.com> wrote:
> hi,all:
> i read the flume user manual,it says "Flume can also report these
> metrics to Ganglia 3 or Ganglia 3.1 metanodes."
>
> i have hadoop cluster (192.168.11.11/12/13/14/15) ,and ganglia gmetad
> installed in 192.168.11.142,also a flume agent installed in
> 192.168.11.12, and i am confused about the host which flume should
> report ,should i write this in flume-env.sh?
>
> JAVA_OPTS="-Xms100m -Xmx200m -Dcom.sun.management.jmxremote
> -Dflume.monitoring.type=ganglia -Dflume.monitoring.hosts=
> 192.168.11.142:8651
>
> # ps -ef|grep gmeta
> root 11365 1739 0 14:27 pts/3 00:00:00 grep gmeta
> nobody 23108 1 6 Oct24 ? 13:16:40 /usr/sbin/gmetad
> # netstat -utlpn|grep 23108
> tcp 0 0 0.0.0.0:8651 0.0.0.0:*
> LISTEN 23108/gmetad
> tcp 0 0 0.0.0.0:8652 0.0.0.0:*
> LISTEN 23108/gmetad
>
>
--
thanks
ashish
Blog: http://www.ashishpaliwal.com/blog
My Photo Galleries: http://www.pbase.com/ashishpaliwal