You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@kafka.apache.org by Xuyen On <xo...@ancestry.com> on 2014/05/19 23:48:06 UTC
SocketServerStats not reporting bytes written or read
Hi all,
I have an intermittent problem with the JMX SocketServer stats on my 0.7.2 Kafka cluster.
I'm collecting the SocketServerStats with jmxstats and everything seems to be working fine except kafka.SocketServerStats:BytesWrittenPerSecond and kafka.SocketServerStats:BytesReadPerSecond are not working all the time. It sometimes will cut out and not report any traffic and then it will randomly report back normal stats. I've noticed that when I started a new topic and starting sending data with a new producer, the stats for bytes written and read will suddenly zero out. Funny thing is that the other stats seem to still be working fine including cumulative bytes read and written.
Does anyone know what might be causing this and how I can fix it?
Thanks,
Xuyen
RE: SocketServerStats not reporting bytes written or read
Posted by Xuyen On <xo...@ancestry.com>.
To be more clear,
1. I am using jmxtrans to get the data not jmstats. Sorry about the misspelling.
2. When I say the stats zero out, I mean that I am not able to get new values when I refresh with a new query from jmxtrans or jconsole. This only happens for the kafka.SocketServerStats:BytesWrittenPerSecond and kafka.SocketServerStats:BytesReadPerSecond stats. The other stats seem to update fine.
Any ideas why this might be?
-----Original Message-----
From: Xuyen On
Sent: Tuesday, May 20, 2014 11:24 AM
To: users@kafka.apache.org
Subject: RE: SocketServerStats not reporting bytes written or read
I checked the stats with jconsole and it confirms the reading I've been getting with jmxtrans so the problem is with the jmx beans themselves I think. The stats just came back to normal again and I don't know why. I haven't made any changes to the kafka brokers.
-----Original Message-----
From: Jun Rao [mailto:junrao@gmail.com]
Sent: Monday, May 19, 2014 9:45 PM
To: users@kafka.apache.org
Subject: Re: SocketServerStats not reporting bytes written or read
Is the problem with the jmx beans themselves or jmxstats?
Thanks,
Jun
On Mon, May 19, 2014 at 2:48 PM, Xuyen On <xo...@ancestry.com> wrote:
> Hi all,
>
> I have an intermittent problem with the JMX SocketServer stats on my
> 0.7.2 Kafka cluster.
> I'm collecting the SocketServerStats with jmxstats and everything
> seems to be working fine except
> kafka.SocketServerStats:BytesWrittenPerSecond and
> kafka.SocketServerStats:BytesReadPerSecond are not working all the
> time. It sometimes will cut out and not report any traffic and then it
> will randomly report back normal stats. I've noticed that when I
> started a new topic and starting sending data with a new producer, the
> stats for bytes written and read will suddenly zero out. Funny thing is that the other stats seem to still be working fine including cumulative bytes read and written.
>
> Does anyone know what might be causing this and how I can fix it?
>
> Thanks,
>
> Xuyen
>
>
>
>
RE: SocketServerStats not reporting bytes written or read
Posted by Xuyen On <xo...@ancestry.com>.
Sorry I lied,
The following do not update:
ProduceRequestsPerSecond
FetchRequestsPerSecond
AvgProduceRequestMs
MaxProduceRequestMs
AvgFetchRequestMs
MaxFetchRequestMs
BytesReadPerSecond
BytesWrittenPerSecond
These stats do update with new values:
NumFetchRequests
NumProduceRequests
TotalBytesRead
TotalFetchRequestMs
TotalProduceRequestMs
-----Original Message-----
From: Xuyen On
Sent: Tuesday, May 20, 2014 11:30 AM
To: 'users@kafka.apache.org'
Subject: RE: SocketServerStats not reporting bytes written or read
To be more clear,
1. I am using jmxtrans to get the data not jmstats. Sorry about the misspelling.
2. When I say the stats zero out, I mean that I am not able to get new values when I refresh with a new query from jmxtrans or jconsole. This only happens for the kafka.SocketServerStats:BytesWrittenPerSecond and kafka.SocketServerStats:BytesReadPerSecond stats. The other stats seem to update fine.
Any ideas why this might be?
-----Original Message-----
From: Xuyen On
Sent: Tuesday, May 20, 2014 11:24 AM
To: users@kafka.apache.org
Subject: RE: SocketServerStats not reporting bytes written or read
I checked the stats with jconsole and it confirms the reading I've been getting with jmxtrans so the problem is with the jmx beans themselves I think. The stats just came back to normal again and I don't know why. I haven't made any changes to the kafka brokers.
-----Original Message-----
From: Jun Rao [mailto:junrao@gmail.com]
Sent: Monday, May 19, 2014 9:45 PM
To: users@kafka.apache.org
Subject: Re: SocketServerStats not reporting bytes written or read
Is the problem with the jmx beans themselves or jmxstats?
Thanks,
Jun
On Mon, May 19, 2014 at 2:48 PM, Xuyen On <xo...@ancestry.com> wrote:
> Hi all,
>
> I have an intermittent problem with the JMX SocketServer stats on my
> 0.7.2 Kafka cluster.
> I'm collecting the SocketServerStats with jmxstats and everything
> seems to be working fine except
> kafka.SocketServerStats:BytesWrittenPerSecond and
> kafka.SocketServerStats:BytesReadPerSecond are not working all the
> time. It sometimes will cut out and not report any traffic and then it
> will randomly report back normal stats. I've noticed that when I
> started a new topic and starting sending data with a new producer, the
> stats for bytes written and read will suddenly zero out. Funny thing is that the other stats seem to still be working fine including cumulative bytes read and written.
>
> Does anyone know what might be causing this and how I can fix it?
>
> Thanks,
>
> Xuyen
>
>
>
>
RE: SocketServerStats not reporting bytes written or read
Posted by Xuyen On <xo...@ancestry.com>.
I checked the stats with jconsole and it confirms the reading I've been getting with jmxtrans so the problem is with the jmx beans themselves I think. The stats just came back to normal again and I don't know why. I haven't made any changes to the kafka brokers.
-----Original Message-----
From: Jun Rao [mailto:junrao@gmail.com]
Sent: Monday, May 19, 2014 9:45 PM
To: users@kafka.apache.org
Subject: Re: SocketServerStats not reporting bytes written or read
Is the problem with the jmx beans themselves or jmxstats?
Thanks,
Jun
On Mon, May 19, 2014 at 2:48 PM, Xuyen On <xo...@ancestry.com> wrote:
> Hi all,
>
> I have an intermittent problem with the JMX SocketServer stats on my
> 0.7.2 Kafka cluster.
> I'm collecting the SocketServerStats with jmxstats and everything
> seems to be working fine except
> kafka.SocketServerStats:BytesWrittenPerSecond and
> kafka.SocketServerStats:BytesReadPerSecond are not working all the
> time. It sometimes will cut out and not report any traffic and then it
> will randomly report back normal stats. I've noticed that when I
> started a new topic and starting sending data with a new producer, the
> stats for bytes written and read will suddenly zero out. Funny thing is that the other stats seem to still be working fine including cumulative bytes read and written.
>
> Does anyone know what might be causing this and how I can fix it?
>
> Thanks,
>
> Xuyen
>
>
>
>
Re: SocketServerStats not reporting bytes written or read
Posted by Jun Rao <ju...@gmail.com>.
Is the problem with the jmx beans themselves or jmxstats?
Thanks,
Jun
On Mon, May 19, 2014 at 2:48 PM, Xuyen On <xo...@ancestry.com> wrote:
> Hi all,
>
> I have an intermittent problem with the JMX SocketServer stats on my 0.7.2
> Kafka cluster.
> I'm collecting the SocketServerStats with jmxstats and everything seems to
> be working fine except kafka.SocketServerStats:BytesWrittenPerSecond and
> kafka.SocketServerStats:BytesReadPerSecond are not working all the time. It
> sometimes will cut out and not report any traffic and then it will randomly
> report back normal stats. I've noticed that when I started a new topic and
> starting sending data with a new producer, the stats for bytes written and
> read will suddenly zero out. Funny thing is that the other stats seem to
> still be working fine including cumulative bytes read and written.
>
> Does anyone know what might be causing this and how I can fix it?
>
> Thanks,
>
> Xuyen
>
>
>
>