You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@flume.apache.org by Juhani Connolly <ju...@cyberagent.co.jp> on 2012/12/12 11:38:12 UTC
Setting up flume to use ganglia results in a lot of error messages
in /var/log/messages
We just noticed that ganglia's gmetad is spamming messages like the
following
Dec 9 03:13:20 om-pat-obs01 /usr/sbin/gmetad[17407]: RRD_update
(/var/lib/ganglia/rrds/Flume KDDI/blog-wap02/flume.SINK.avro2.Type.rrd):
/var/lib/ganglia/rrds/Flume KDDI/blog-wap02/flume.SINK.avro2.Type.rrd:
conversion of 'SINK' to float not complete: tail 'SINK'
Dec 9 03:13:20 om-pat-obs01 /usr/sbin/gmetad[17407]: RRD_update
(/var/lib/ganglia/rrds/Flume
KDDI/blog-wap02/flume.CHANNEL.ch1.Type.rrd): /var/lib/ganglia/rrds/Flume
KDDI/blog-wap02/flume.CHANNEL.ch1.Type.rrd: conversion of 'CHANNEL' to
float not complete: tail 'CHANNEL'
Dec 9 03:13:20 om-pat-obs01 /usr/sbin/gmetad[17407]: RRD_update
(/var/lib/ganglia/rrds/Flume KDDI/blog-wap11/flume.SINK.avro1.Type.rrd):
/var/lib/ganglia/rrds/Flume KDDI/blog-wap11/flume.SINK.avro1.Type.rrd:
conversion of 'SINK' to float not complete: tail 'SINK'
Dec 9 03:13:20 om-pat-obs01 /usr/sbin/gmetad[17407]: RRD_update
(/var/lib/ganglia/rrds/Flume
KDDI/blog-wap11/flume.SOURCE.scribe.Type.rrd):
/var/lib/ganglia/rrds/Flume
KDDI/blog-wap11/flume.SOURCE.scribe.Type.rrd: conversion of 'SOURCE' to
float not complete: tail 'SOURCE'
The counters are tracked fine on the web interface, but we've had
issues(gmetad crashing or not starting up, I'm still trying to get
specifics from the responsible people). I can't say for sure if this is
a ganglia problem or a problem with flumes ganglia support. Anyone else
feeding their counters to ganglia getting similar? Perhaps the ganglia
ml may be more appropriate, not sure on this one.
Re: Setting up flume to use ganglia results in a lot of error
messages in /var/log/messages
Posted by Hari Shreedharan <hs...@cloudera.com>.
I attached a patch to FLUME-1870. Can you guys give it a try and see if you are hitting the issue now?
Hari
--
Hari Shreedharan
On Wednesday, January 23, 2013 at 1:38 PM, Hari Shreedharan wrote:
> Looks like this is happening because for certain metrics which cannot be converted into float (for example strings), we are sending the type as float, causing Ganglia to log those messages. I think it should be fairly easy to write a patch to fix this. I filed FLUME-1870 to track this.
>
>
> Thanks,
> Hari
>
> --
> Hari Shreedharan
>
>
> On Wednesday, January 23, 2013 at 1:23 PM, Mike Percy wrote:
>
> > Not sure when or how it broke, as I know of people using it in production. There is a way to configure it for different versions of Ganglia, like 3.0, 3.1. Might be worth trying both values to see if it's a problem with one or the other: http://flume.apache.org/FlumeUserGuide.html#ganglia-reporting
> >
> >
> > On Wed, Jan 23, 2013 at 1:12 PM, Connor Woodson <cwoodson.dev@gmail.com (mailto:cwoodson.dev@gmail.com)> wrote:
> > > I have not had success with Ganglia, due to the same issue I think as you've encountered.
> > >
> > > - Connor
> > >
> > >
> > > On Wed, Jan 23, 2013 at 6:04 AM, Christian Schroer <cschroer@autoscout24.com (mailto:cschroer@autoscout24.com)> wrote:
> > > > Hi,
> > > >
> > > > i have the same problem here, using Flume-NG 1.2 from CDH4.1.2.
> > > > I deleted all related RRDs, gmetad recreates them and i see those errors again.
> > > >
> > > > Disk space, inodes, ... are fine. All RRDs not related to Flume-NG are fine, too.
> > > >
> > > > These errors result in a gmetad crash after while (more metrics => earlier crash). If I disable ganglia support gmetad runs without any problem.
> > > >
> > > > Regards
> > > > Christian
> > > >
> > > > -----Ursprüngliche Nachricht-----
> > > > Von: Alexander Alten-Lorenz [mailto:wget.null@gmail.com]
> > > > Gesendet: Mittwoch, 12. Dezember 2012 15:43
> > > > An: user@flume.apache.org (mailto:user@flume.apache.org)
> > > > Betreff: Re: Setting up flume to use ganglia results in a lot of error messages in /var/log/messages
> > > >
> > > > Looks like the RRD's are damaged, maybe the harddisk full?
> > > >
> > > > - Alex
> > > >
> > > > On Dec 12, 2012, at 11:38 AM, Juhani Connolly <juhani_connolly@cyberagent.co.jp (mailto:juhani_connolly@cyberagent.co.jp)> wrote:
> > > >
> > > > > We just noticed that ganglia's gmetad is spamming messages like the following
> > > > >
> > > > > Dec 9 03:13:20 om-pat-obs01 /usr/sbin/gmetad[17407]: RRD_update (/var/lib/ganglia/rrds/Flume KDDI/blog-wap02/flume.SINK.avro2.Type.rrd): /var/lib/ganglia/rrds/Flume KDDI/blog-wap02/flume.SINK.avro2.Type.rrd: conversion of 'SINK' to float not complete: tail 'SINK'
> > > > > Dec 9 03:13:20 om-pat-obs01 /usr/sbin/gmetad[17407]: RRD_update (/var/lib/ganglia/rrds/Flume KDDI/blog-wap02/flume.CHANNEL.ch1.Type.rrd): /var/lib/ganglia/rrds/Flume KDDI/blog-wap02/flume.CHANNEL.ch1.Type.rrd: conversion of 'CHANNEL' to float not complete: tail 'CHANNEL'
> > > > > Dec 9 03:13:20 om-pat-obs01 /usr/sbin/gmetad[17407]: RRD_update (/var/lib/ganglia/rrds/Flume KDDI/blog-wap11/flume.SINK.avro1.Type.rrd): /var/lib/ganglia/rrds/Flume KDDI/blog-wap11/flume.SINK.avro1.Type.rrd: conversion of 'SINK' to float not complete: tail 'SINK'
> > > > > Dec 9 03:13:20 om-pat-obs01 /usr/sbin/gmetad[17407]: RRD_update (/var/lib/ganglia/rrds/Flume KDDI/blog-wap11/flume.SOURCE.scribe.Type.rrd): /var/lib/ganglia/rrds/Flume KDDI/blog-wap11/flume.SOURCE.scribe.Type.rrd: conversion of 'SOURCE' to float not complete: tail 'SOURCE'
> > > > >
> > > > > The counters are tracked fine on the web interface, but we've had issues(gmetad crashing or not starting up, I'm still trying to get specifics from the responsible people). I can't say for sure if this is a ganglia problem or a problem with flumes ganglia support. Anyone else feeding their counters to ganglia getting similar? Perhaps the ganglia ml may be more appropriate, not sure on this one.
> > > >
> > > > --
> > > > Alexander Alten-Lorenz
> > > > http://mapredit.blogspot.com
> > > > German Hadoop LinkedIn Group: http://goo.gl/N8pCF
> > > >
> > >
> >
>
Re: Setting up flume to use ganglia results in a lot of error
messages in /var/log/messages
Posted by Hari Shreedharan <hs...@cloudera.com>.
Looks like this is happening because for certain metrics which cannot be converted into float (for example strings), we are sending the type as float, causing Ganglia to log those messages. I think it should be fairly easy to write a patch to fix this. I filed FLUME-1870 to track this.
Thanks,
Hari
--
Hari Shreedharan
On Wednesday, January 23, 2013 at 1:23 PM, Mike Percy wrote:
> Not sure when or how it broke, as I know of people using it in production. There is a way to configure it for different versions of Ganglia, like 3.0, 3.1. Might be worth trying both values to see if it's a problem with one or the other: http://flume.apache.org/FlumeUserGuide.html#ganglia-reporting
>
>
> On Wed, Jan 23, 2013 at 1:12 PM, Connor Woodson <cwoodson.dev@gmail.com (mailto:cwoodson.dev@gmail.com)> wrote:
> > I have not had success with Ganglia, due to the same issue I think as you've encountered.
> >
> > - Connor
> >
> >
> > On Wed, Jan 23, 2013 at 6:04 AM, Christian Schroer <cschroer@autoscout24.com (mailto:cschroer@autoscout24.com)> wrote:
> > > Hi,
> > >
> > > i have the same problem here, using Flume-NG 1.2 from CDH4.1.2.
> > > I deleted all related RRDs, gmetad recreates them and i see those errors again.
> > >
> > > Disk space, inodes, ... are fine. All RRDs not related to Flume-NG are fine, too.
> > >
> > > These errors result in a gmetad crash after while (more metrics => earlier crash). If I disable ganglia support gmetad runs without any problem.
> > >
> > > Regards
> > > Christian
> > >
> > > -----Ursprüngliche Nachricht-----
> > > Von: Alexander Alten-Lorenz [mailto:wget.null@gmail.com]
> > > Gesendet: Mittwoch, 12. Dezember 2012 15:43
> > > An: user@flume.apache.org (mailto:user@flume.apache.org)
> > > Betreff: Re: Setting up flume to use ganglia results in a lot of error messages in /var/log/messages
> > >
> > > Looks like the RRD's are damaged, maybe the harddisk full?
> > >
> > > - Alex
> > >
> > > On Dec 12, 2012, at 11:38 AM, Juhani Connolly <juhani_connolly@cyberagent.co.jp (mailto:juhani_connolly@cyberagent.co.jp)> wrote:
> > >
> > > > We just noticed that ganglia's gmetad is spamming messages like the following
> > > >
> > > > Dec 9 03:13:20 om-pat-obs01 /usr/sbin/gmetad[17407]: RRD_update (/var/lib/ganglia/rrds/Flume KDDI/blog-wap02/flume.SINK.avro2.Type.rrd): /var/lib/ganglia/rrds/Flume KDDI/blog-wap02/flume.SINK.avro2.Type.rrd: conversion of 'SINK' to float not complete: tail 'SINK'
> > > > Dec 9 03:13:20 om-pat-obs01 /usr/sbin/gmetad[17407]: RRD_update (/var/lib/ganglia/rrds/Flume KDDI/blog-wap02/flume.CHANNEL.ch1.Type.rrd): /var/lib/ganglia/rrds/Flume KDDI/blog-wap02/flume.CHANNEL.ch1.Type.rrd: conversion of 'CHANNEL' to float not complete: tail 'CHANNEL'
> > > > Dec 9 03:13:20 om-pat-obs01 /usr/sbin/gmetad[17407]: RRD_update (/var/lib/ganglia/rrds/Flume KDDI/blog-wap11/flume.SINK.avro1.Type.rrd): /var/lib/ganglia/rrds/Flume KDDI/blog-wap11/flume.SINK.avro1.Type.rrd: conversion of 'SINK' to float not complete: tail 'SINK'
> > > > Dec 9 03:13:20 om-pat-obs01 /usr/sbin/gmetad[17407]: RRD_update (/var/lib/ganglia/rrds/Flume KDDI/blog-wap11/flume.SOURCE.scribe.Type.rrd): /var/lib/ganglia/rrds/Flume KDDI/blog-wap11/flume.SOURCE.scribe.Type.rrd: conversion of 'SOURCE' to float not complete: tail 'SOURCE'
> > > >
> > > > The counters are tracked fine on the web interface, but we've had issues(gmetad crashing or not starting up, I'm still trying to get specifics from the responsible people). I can't say for sure if this is a ganglia problem or a problem with flumes ganglia support. Anyone else feeding their counters to ganglia getting similar? Perhaps the ganglia ml may be more appropriate, not sure on this one.
> > >
> > > --
> > > Alexander Alten-Lorenz
> > > http://mapredit.blogspot.com
> > > German Hadoop LinkedIn Group: http://goo.gl/N8pCF
> > >
> >
>
Re: Setting up flume to use ganglia results in a lot of error
messages in /var/log/messages
Posted by Mike Percy <mp...@apache.org>.
Not sure when or how it broke, as I know of people using it in production.
There is a way to configure it for different versions of Ganglia, like 3.0,
3.1. Might be worth trying both values to see if it's a problem with one or
the other: http://flume.apache.org/FlumeUserGuide.html#ganglia-reporting
On Wed, Jan 23, 2013 at 1:12 PM, Connor Woodson <cw...@gmail.com>wrote:
> I have not had success with Ganglia, due to the same issue I think as
> you've encountered.
>
> - Connor
>
>
> On Wed, Jan 23, 2013 at 6:04 AM, Christian Schroer <
> cschroer@autoscout24.com> wrote:
>
>> Hi,
>>
>> i have the same problem here, using Flume-NG 1.2 from CDH4.1.2.
>> I deleted all related RRDs, gmetad recreates them and i see those errors
>> again.
>>
>> Disk space, inodes, ... are fine. All RRDs not related to Flume-NG are
>> fine, too.
>>
>> These errors result in a gmetad crash after while (more metrics =>
>> earlier crash). If I disable ganglia support gmetad runs without any
>> problem.
>>
>> Regards
>> Christian
>>
>> -----Ursprüngliche Nachricht-----
>> Von: Alexander Alten-Lorenz [mailto:wget.null@gmail.com]
>> Gesendet: Mittwoch, 12. Dezember 2012 15:43
>> An: user@flume.apache.org
>> Betreff: Re: Setting up flume to use ganglia results in a lot of error
>> messages in /var/log/messages
>>
>> Looks like the RRD's are damaged, maybe the harddisk full?
>>
>> - Alex
>>
>> On Dec 12, 2012, at 11:38 AM, Juhani Connolly <
>> juhani_connolly@cyberagent.co.jp> wrote:
>>
>> > We just noticed that ganglia's gmetad is spamming messages like the
>> following
>> >
>> > Dec 9 03:13:20 om-pat-obs01 /usr/sbin/gmetad[17407]: RRD_update
>> (/var/lib/ganglia/rrds/Flume KDDI/blog-wap02/flume.SINK.avro2.Type.rrd):
>> /var/lib/ganglia/rrds/Flume KDDI/blog-wap02/flume.SINK.avro2.Type.rrd:
>> conversion of 'SINK' to float not complete: tail 'SINK'
>> > Dec 9 03:13:20 om-pat-obs01 /usr/sbin/gmetad[17407]: RRD_update
>> (/var/lib/ganglia/rrds/Flume KDDI/blog-wap02/flume.CHANNEL.ch1.Type.rrd):
>> /var/lib/ganglia/rrds/Flume KDDI/blog-wap02/flume.CHANNEL.ch1.Type.rrd:
>> conversion of 'CHANNEL' to float not complete: tail 'CHANNEL'
>> > Dec 9 03:13:20 om-pat-obs01 /usr/sbin/gmetad[17407]: RRD_update
>> (/var/lib/ganglia/rrds/Flume KDDI/blog-wap11/flume.SINK.avro1.Type.rrd):
>> /var/lib/ganglia/rrds/Flume KDDI/blog-wap11/flume.SINK.avro1.Type.rrd:
>> conversion of 'SINK' to float not complete: tail 'SINK'
>> > Dec 9 03:13:20 om-pat-obs01 /usr/sbin/gmetad[17407]: RRD_update
>> (/var/lib/ganglia/rrds/Flume KDDI/blog-wap11/flume.SOURCE.scribe.Type.rrd):
>> /var/lib/ganglia/rrds/Flume KDDI/blog-wap11/flume.SOURCE.scribe.Type.rrd:
>> conversion of 'SOURCE' to float not complete: tail 'SOURCE'
>> >
>> > The counters are tracked fine on the web interface, but we've had
>> issues(gmetad crashing or not starting up, I'm still trying to get
>> specifics from the responsible people). I can't say for sure if this is a
>> ganglia problem or a problem with flumes ganglia support. Anyone else
>> feeding their counters to ganglia getting similar? Perhaps the ganglia ml
>> may be more appropriate, not sure on this one.
>>
>> --
>> Alexander Alten-Lorenz
>> http://mapredit.blogspot.com
>> German Hadoop LinkedIn Group: http://goo.gl/N8pCF
>>
>>
>
Re: Setting up flume to use ganglia results in a lot of error
messages in /var/log/messages
Posted by Connor Woodson <cw...@gmail.com>.
I have not had success with Ganglia, due to the same issue I think as
you've encountered.
- Connor
On Wed, Jan 23, 2013 at 6:04 AM, Christian Schroer <cschroer@autoscout24.com
> wrote:
> Hi,
>
> i have the same problem here, using Flume-NG 1.2 from CDH4.1.2.
> I deleted all related RRDs, gmetad recreates them and i see those errors
> again.
>
> Disk space, inodes, ... are fine. All RRDs not related to Flume-NG are
> fine, too.
>
> These errors result in a gmetad crash after while (more metrics => earlier
> crash). If I disable ganglia support gmetad runs without any problem.
>
> Regards
> Christian
>
> -----Ursprüngliche Nachricht-----
> Von: Alexander Alten-Lorenz [mailto:wget.null@gmail.com]
> Gesendet: Mittwoch, 12. Dezember 2012 15:43
> An: user@flume.apache.org
> Betreff: Re: Setting up flume to use ganglia results in a lot of error
> messages in /var/log/messages
>
> Looks like the RRD's are damaged, maybe the harddisk full?
>
> - Alex
>
> On Dec 12, 2012, at 11:38 AM, Juhani Connolly <
> juhani_connolly@cyberagent.co.jp> wrote:
>
> > We just noticed that ganglia's gmetad is spamming messages like the
> following
> >
> > Dec 9 03:13:20 om-pat-obs01 /usr/sbin/gmetad[17407]: RRD_update
> (/var/lib/ganglia/rrds/Flume KDDI/blog-wap02/flume.SINK.avro2.Type.rrd):
> /var/lib/ganglia/rrds/Flume KDDI/blog-wap02/flume.SINK.avro2.Type.rrd:
> conversion of 'SINK' to float not complete: tail 'SINK'
> > Dec 9 03:13:20 om-pat-obs01 /usr/sbin/gmetad[17407]: RRD_update
> (/var/lib/ganglia/rrds/Flume KDDI/blog-wap02/flume.CHANNEL.ch1.Type.rrd):
> /var/lib/ganglia/rrds/Flume KDDI/blog-wap02/flume.CHANNEL.ch1.Type.rrd:
> conversion of 'CHANNEL' to float not complete: tail 'CHANNEL'
> > Dec 9 03:13:20 om-pat-obs01 /usr/sbin/gmetad[17407]: RRD_update
> (/var/lib/ganglia/rrds/Flume KDDI/blog-wap11/flume.SINK.avro1.Type.rrd):
> /var/lib/ganglia/rrds/Flume KDDI/blog-wap11/flume.SINK.avro1.Type.rrd:
> conversion of 'SINK' to float not complete: tail 'SINK'
> > Dec 9 03:13:20 om-pat-obs01 /usr/sbin/gmetad[17407]: RRD_update
> (/var/lib/ganglia/rrds/Flume KDDI/blog-wap11/flume.SOURCE.scribe.Type.rrd):
> /var/lib/ganglia/rrds/Flume KDDI/blog-wap11/flume.SOURCE.scribe.Type.rrd:
> conversion of 'SOURCE' to float not complete: tail 'SOURCE'
> >
> > The counters are tracked fine on the web interface, but we've had
> issues(gmetad crashing or not starting up, I'm still trying to get
> specifics from the responsible people). I can't say for sure if this is a
> ganglia problem or a problem with flumes ganglia support. Anyone else
> feeding their counters to ganglia getting similar? Perhaps the ganglia ml
> may be more appropriate, not sure on this one.
>
> --
> Alexander Alten-Lorenz
> http://mapredit.blogspot.com
> German Hadoop LinkedIn Group: http://goo.gl/N8pCF
>
>
AW: Setting up flume to use ganglia results in a lot of error
messages in /var/log/messages
Posted by Christian Schroer <cs...@autoscout24.com>.
Hi,
i have the same problem here, using Flume-NG 1.2 from CDH4.1.2.
I deleted all related RRDs, gmetad recreates them and i see those errors again.
Disk space, inodes, ... are fine. All RRDs not related to Flume-NG are fine, too.
These errors result in a gmetad crash after while (more metrics => earlier crash). If I disable ganglia support gmetad runs without any problem.
Regards
Christian
-----Ursprüngliche Nachricht-----
Von: Alexander Alten-Lorenz [mailto:wget.null@gmail.com]
Gesendet: Mittwoch, 12. Dezember 2012 15:43
An: user@flume.apache.org
Betreff: Re: Setting up flume to use ganglia results in a lot of error messages in /var/log/messages
Looks like the RRD's are damaged, maybe the harddisk full?
- Alex
On Dec 12, 2012, at 11:38 AM, Juhani Connolly <ju...@cyberagent.co.jp> wrote:
> We just noticed that ganglia's gmetad is spamming messages like the following
>
> Dec 9 03:13:20 om-pat-obs01 /usr/sbin/gmetad[17407]: RRD_update (/var/lib/ganglia/rrds/Flume KDDI/blog-wap02/flume.SINK.avro2.Type.rrd): /var/lib/ganglia/rrds/Flume KDDI/blog-wap02/flume.SINK.avro2.Type.rrd: conversion of 'SINK' to float not complete: tail 'SINK'
> Dec 9 03:13:20 om-pat-obs01 /usr/sbin/gmetad[17407]: RRD_update (/var/lib/ganglia/rrds/Flume KDDI/blog-wap02/flume.CHANNEL.ch1.Type.rrd): /var/lib/ganglia/rrds/Flume KDDI/blog-wap02/flume.CHANNEL.ch1.Type.rrd: conversion of 'CHANNEL' to float not complete: tail 'CHANNEL'
> Dec 9 03:13:20 om-pat-obs01 /usr/sbin/gmetad[17407]: RRD_update (/var/lib/ganglia/rrds/Flume KDDI/blog-wap11/flume.SINK.avro1.Type.rrd): /var/lib/ganglia/rrds/Flume KDDI/blog-wap11/flume.SINK.avro1.Type.rrd: conversion of 'SINK' to float not complete: tail 'SINK'
> Dec 9 03:13:20 om-pat-obs01 /usr/sbin/gmetad[17407]: RRD_update (/var/lib/ganglia/rrds/Flume KDDI/blog-wap11/flume.SOURCE.scribe.Type.rrd): /var/lib/ganglia/rrds/Flume KDDI/blog-wap11/flume.SOURCE.scribe.Type.rrd: conversion of 'SOURCE' to float not complete: tail 'SOURCE'
>
> The counters are tracked fine on the web interface, but we've had issues(gmetad crashing or not starting up, I'm still trying to get specifics from the responsible people). I can't say for sure if this is a ganglia problem or a problem with flumes ganglia support. Anyone else feeding their counters to ganglia getting similar? Perhaps the ganglia ml may be more appropriate, not sure on this one.
--
Alexander Alten-Lorenz
http://mapredit.blogspot.com
German Hadoop LinkedIn Group: http://goo.gl/N8pCF
Re: Setting up flume to use ganglia results in a lot of error messages in /var/log/messages
Posted by Alexander Alten-Lorenz <wg...@gmail.com>.
Looks like the RRD's are damaged, maybe the harddisk full?
- Alex
On Dec 12, 2012, at 11:38 AM, Juhani Connolly <ju...@cyberagent.co.jp> wrote:
> We just noticed that ganglia's gmetad is spamming messages like the following
>
> Dec 9 03:13:20 om-pat-obs01 /usr/sbin/gmetad[17407]: RRD_update (/var/lib/ganglia/rrds/Flume KDDI/blog-wap02/flume.SINK.avro2.Type.rrd): /var/lib/ganglia/rrds/Flume KDDI/blog-wap02/flume.SINK.avro2.Type.rrd: conversion of 'SINK' to float not complete: tail 'SINK'
> Dec 9 03:13:20 om-pat-obs01 /usr/sbin/gmetad[17407]: RRD_update (/var/lib/ganglia/rrds/Flume KDDI/blog-wap02/flume.CHANNEL.ch1.Type.rrd): /var/lib/ganglia/rrds/Flume KDDI/blog-wap02/flume.CHANNEL.ch1.Type.rrd: conversion of 'CHANNEL' to float not complete: tail 'CHANNEL'
> Dec 9 03:13:20 om-pat-obs01 /usr/sbin/gmetad[17407]: RRD_update (/var/lib/ganglia/rrds/Flume KDDI/blog-wap11/flume.SINK.avro1.Type.rrd): /var/lib/ganglia/rrds/Flume KDDI/blog-wap11/flume.SINK.avro1.Type.rrd: conversion of 'SINK' to float not complete: tail 'SINK'
> Dec 9 03:13:20 om-pat-obs01 /usr/sbin/gmetad[17407]: RRD_update (/var/lib/ganglia/rrds/Flume KDDI/blog-wap11/flume.SOURCE.scribe.Type.rrd): /var/lib/ganglia/rrds/Flume KDDI/blog-wap11/flume.SOURCE.scribe.Type.rrd: conversion of 'SOURCE' to float not complete: tail 'SOURCE'
>
> The counters are tracked fine on the web interface, but we've had issues(gmetad crashing or not starting up, I'm still trying to get specifics from the responsible people). I can't say for sure if this is a ganglia problem or a problem with flumes ganglia support. Anyone else feeding their counters to ganglia getting similar? Perhaps the ganglia ml may be more appropriate, not sure on this one.
--
Alexander Alten-Lorenz
http://mapredit.blogspot.com
German Hadoop LinkedIn Group: http://goo.gl/N8pCF