You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@kafka.apache.org by Hanish Bansal <ha...@gmail.com> on 2013/07/01 13:31:27 UTC

Kafka Metrics in 0.8

Hi

I am getting various kafka parameters (like NumFetchRequests,
FetchRequestsPerSecond, ProduceRequestsPerSecond etc.) through JMX in case
of kafka-0.7.

In kafka-0.8 i am doing the same but not able to get parameters.

There are some changes in reporting metrics in kafka-0.8 as compared to
kafka-0.7. I have already noticed that. According to changes in kafka-0.8 i
am trying to get kafka metrics using JMX through jmxtrans api.

Here is sample java code of getting jmx parameters using jmxtrans api:

       Server kafkaJMXServer = new Server("127.0.0.1", "9999");
        Query query1 = new Query();

query1.setObj("kafka.server:type=BrokerTopicMetrics,name=AllTopicsBytesInPerSec");
        query1.addAttr("MeanRate");
        kafkaJMXServer.addQuery(query1);
        JmxProcess process = new JmxProcess(kafkaJMXServer);
        JmxUtils.execute(process);
        System.out.println(query1.getResults());

Please let me know what i am missing?

-- 
*Thanks & Regards*
*Hanish Bansal*

Re: Kafka Metrics in 0.8

Posted by Jun Rao <ju...@gmail.com>.
Could you run kafka-list-topics to see whether the leader of those
partitions are distributed on both brokers?

Thanks,

Jun


On Mon, Jul 29, 2013 at 10:48 PM, Hanish Bansal <
hanish.bansal.agarwal@gmail.com> wrote:

> Yes, Kafka data shows up in the log dir in kafka-2. We are having 2
> partitions on all brokers.
>
>
> On Mon, Jul 29, 2013 at 8:25 PM, Jun Rao <ju...@gmail.com> wrote:
>
> > Does the Kafka data show up in the log dir in kafka-2? Since only the
> > leader can serve any traffic, if there is only have one partition or all
> > leaders are on one broker, not all metrics (e.g., produce/fetch rate)
> will
> > show up on both brokers.
> >
> > Thanks,
> >
> > Jun
> >
> >
> > On Mon, Jul 29, 2013 at 6:04 AM, Hanish Bansal <
> > hanish.bansal.agarwal@gmail.com> wrote:
> >
> > > Hi All,
> > >
> > > As kafka-0.8's main feature in data replication.
> > >
> > > We are running two kafka nodes(lets say: kafka-1 and kafka-2) in
> cluster
> > > mode. If we produce data into kafka using replication factor=2 then its
> > > replica is created on second machine.
> > >
> > > I am using jconsole to monitor kafka. if messages are going on kafka-1
> > then
> > > i am able to see kafka metrics on jconsole of kafka-1. But by
> connecting
> > to
> > > jconsole for kafka-2 i am not seeing any metrics, i want to know why it
> > is
> > > happening ??
> > >
> > > For more clarity i am asking same question in other way:
> > > If one kafka node is storing replicas of data, then will it be visible
> on
> > > jconsole or not ?
> > >
> > >
> > >
> > >
> > >
> > >
> > > On Wed, Jul 3, 2013 at 1:06 PM, Hanish Bansal <
> > > hanish.bansal.agarwal@gmail.com> wrote:
> > >
> > > > Thanks Jun
> > > >
> > > >
> > > > On Tue, Jul 2, 2013 at 2:35 PM, Jun Rao <ju...@gmail.com> wrote:
> > > >
> > > >> In 0.8, there are more mbeans than 0.7.
> > > >>
> > > >> Thanks,
> > > >>
> > > >> Jun
> > > >>
> > > >>
> > > >> On Mon, Jul 1, 2013 at 9:06 PM, Hanish Bansal <
> > > >> hanish.bansal.agarwal@gmail.com> wrote:
> > > >>
> > > >> > Okay i'll try for same.
> > > >> >
> > > >> > Also want to know that in kafka-0.7 there is single MBean -
> > > >> > SocketServerStats which provides all kafka Metrics. But in
> Kafka-0-8
> > > >> there
> > > >> > are individual MBeans (like AllTopicsBytesInPerSec,
> > > >> AllTopicsBytesOutPerSec
> > > >> > etc.) for getting each parameter like ByteInRate, ByteOutRate etc.
> > > >> >
> > > >> > Does kafka-0.8 provide any single MBean from which we can get all
> > > >> > parameters?
> > > >> >
> > > >> >
> > > >> >
> > > >> >
> > > >> > On Mon, Jul 1, 2013 at 3:47 PM, Jun Rao <ju...@gmail.com> wrote:
> > > >> >
> > > >> > > It seems that the mbean name that you used is wrong. The mbean
> > names
> > > >> > > registered by metrics 2.2.0 have quotes in them.
> > > >> > >
> > > >> > > Thanks,
> > > >> > >
> > > >> > > Jun
> > > >> > >
> > > >> > >
> > > >> > > On Mon, Jul 1, 2013 at 4:31 AM, Hanish Bansal <
> > > >> > > hanish.bansal.agarwal@gmail.com> wrote:
> > > >> > >
> > > >> > > > Hi
> > > >> > > >
> > > >> > > > I am getting various kafka parameters (like NumFetchRequests,
> > > >> > > > FetchRequestsPerSecond, ProduceRequestsPerSecond etc.) through
> > JMX
> > > >> in
> > > >> > > case
> > > >> > > > of kafka-0.7.
> > > >> > > >
> > > >> > > > In kafka-0.8 i am doing the same but not able to get
> parameters.
> > > >> > > >
> > > >> > > > There are some changes in reporting metrics in kafka-0.8 as
> > > >> compared to
> > > >> > > > kafka-0.7. I have already noticed that. According to changes
> in
> > > >> > > kafka-0.8 i
> > > >> > > > am trying to get kafka metrics using JMX through jmxtrans api.
> > > >> > > >
> > > >> > > > Here is sample java code of getting jmx parameters using
> > jmxtrans
> > > >> api:
> > > >> > > >
> > > >> > > >        Server kafkaJMXServer = new Server("127.0.0.1",
> "9999");
> > > >> > > >         Query query1 = new Query();
> > > >> > > >
> > > >> > > >
> > > >> > > >
> > > >> > >
> > > >> >
> > > >>
> > >
> >
> query1.setObj("kafka.server:type=BrokerTopicMetrics,name=AllTopicsBytesInPerSec");
> > > >> > > >         query1.addAttr("MeanRate");
> > > >> > > >         kafkaJMXServer.addQuery(query1);
> > > >> > > >         JmxProcess process = new JmxProcess(kafkaJMXServer);
> > > >> > > >         JmxUtils.execute(process);
> > > >> > > >         System.out.println(query1.getResults());
> > > >> > > >
> > > >> > > > Please let me know what i am missing?
> > > >> > > >
> > > >> > > > --
> > > >> > > > *Thanks & Regards*
> > > >> > > > *Hanish Bansal*
> > > >> > > >
> > > >> > >
> > > >> >
> > > >> >
> > > >> >
> > > >> > --
> > > >> > *Thanks & Regards*
> > > >> > *Hanish Bansal*
> > > >> >
> > > >>
> > > >
> > > >
> > > >
> > > > --
> > > > *Thanks & Regards*
> > > > *Hanish Bansal*
> > > >
> > >
> > >
> > >
> > > --
> > > *Thanks & Regards*
> > > *Hanish Bansal*
> > >
> >
>
>
>
> --
> *Thanks & Regards*
> *Hanish Bansal*
>

Re: Kafka Metrics in 0.8

Posted by Hanish Bansal <ha...@gmail.com>.
Yes, Kafka data shows up in the log dir in kafka-2. We are having 2
partitions on all brokers.


On Mon, Jul 29, 2013 at 8:25 PM, Jun Rao <ju...@gmail.com> wrote:

> Does the Kafka data show up in the log dir in kafka-2? Since only the
> leader can serve any traffic, if there is only have one partition or all
> leaders are on one broker, not all metrics (e.g., produce/fetch rate) will
> show up on both brokers.
>
> Thanks,
>
> Jun
>
>
> On Mon, Jul 29, 2013 at 6:04 AM, Hanish Bansal <
> hanish.bansal.agarwal@gmail.com> wrote:
>
> > Hi All,
> >
> > As kafka-0.8's main feature in data replication.
> >
> > We are running two kafka nodes(lets say: kafka-1 and kafka-2) in cluster
> > mode. If we produce data into kafka using replication factor=2 then its
> > replica is created on second machine.
> >
> > I am using jconsole to monitor kafka. if messages are going on kafka-1
> then
> > i am able to see kafka metrics on jconsole of kafka-1. But by connecting
> to
> > jconsole for kafka-2 i am not seeing any metrics, i want to know why it
> is
> > happening ??
> >
> > For more clarity i am asking same question in other way:
> > If one kafka node is storing replicas of data, then will it be visible on
> > jconsole or not ?
> >
> >
> >
> >
> >
> >
> > On Wed, Jul 3, 2013 at 1:06 PM, Hanish Bansal <
> > hanish.bansal.agarwal@gmail.com> wrote:
> >
> > > Thanks Jun
> > >
> > >
> > > On Tue, Jul 2, 2013 at 2:35 PM, Jun Rao <ju...@gmail.com> wrote:
> > >
> > >> In 0.8, there are more mbeans than 0.7.
> > >>
> > >> Thanks,
> > >>
> > >> Jun
> > >>
> > >>
> > >> On Mon, Jul 1, 2013 at 9:06 PM, Hanish Bansal <
> > >> hanish.bansal.agarwal@gmail.com> wrote:
> > >>
> > >> > Okay i'll try for same.
> > >> >
> > >> > Also want to know that in kafka-0.7 there is single MBean -
> > >> > SocketServerStats which provides all kafka Metrics. But in Kafka-0-8
> > >> there
> > >> > are individual MBeans (like AllTopicsBytesInPerSec,
> > >> AllTopicsBytesOutPerSec
> > >> > etc.) for getting each parameter like ByteInRate, ByteOutRate etc.
> > >> >
> > >> > Does kafka-0.8 provide any single MBean from which we can get all
> > >> > parameters?
> > >> >
> > >> >
> > >> >
> > >> >
> > >> > On Mon, Jul 1, 2013 at 3:47 PM, Jun Rao <ju...@gmail.com> wrote:
> > >> >
> > >> > > It seems that the mbean name that you used is wrong. The mbean
> names
> > >> > > registered by metrics 2.2.0 have quotes in them.
> > >> > >
> > >> > > Thanks,
> > >> > >
> > >> > > Jun
> > >> > >
> > >> > >
> > >> > > On Mon, Jul 1, 2013 at 4:31 AM, Hanish Bansal <
> > >> > > hanish.bansal.agarwal@gmail.com> wrote:
> > >> > >
> > >> > > > Hi
> > >> > > >
> > >> > > > I am getting various kafka parameters (like NumFetchRequests,
> > >> > > > FetchRequestsPerSecond, ProduceRequestsPerSecond etc.) through
> JMX
> > >> in
> > >> > > case
> > >> > > > of kafka-0.7.
> > >> > > >
> > >> > > > In kafka-0.8 i am doing the same but not able to get parameters.
> > >> > > >
> > >> > > > There are some changes in reporting metrics in kafka-0.8 as
> > >> compared to
> > >> > > > kafka-0.7. I have already noticed that. According to changes in
> > >> > > kafka-0.8 i
> > >> > > > am trying to get kafka metrics using JMX through jmxtrans api.
> > >> > > >
> > >> > > > Here is sample java code of getting jmx parameters using
> jmxtrans
> > >> api:
> > >> > > >
> > >> > > >        Server kafkaJMXServer = new Server("127.0.0.1", "9999");
> > >> > > >         Query query1 = new Query();
> > >> > > >
> > >> > > >
> > >> > > >
> > >> > >
> > >> >
> > >>
> >
> query1.setObj("kafka.server:type=BrokerTopicMetrics,name=AllTopicsBytesInPerSec");
> > >> > > >         query1.addAttr("MeanRate");
> > >> > > >         kafkaJMXServer.addQuery(query1);
> > >> > > >         JmxProcess process = new JmxProcess(kafkaJMXServer);
> > >> > > >         JmxUtils.execute(process);
> > >> > > >         System.out.println(query1.getResults());
> > >> > > >
> > >> > > > Please let me know what i am missing?
> > >> > > >
> > >> > > > --
> > >> > > > *Thanks & Regards*
> > >> > > > *Hanish Bansal*
> > >> > > >
> > >> > >
> > >> >
> > >> >
> > >> >
> > >> > --
> > >> > *Thanks & Regards*
> > >> > *Hanish Bansal*
> > >> >
> > >>
> > >
> > >
> > >
> > > --
> > > *Thanks & Regards*
> > > *Hanish Bansal*
> > >
> >
> >
> >
> > --
> > *Thanks & Regards*
> > *Hanish Bansal*
> >
>



-- 
*Thanks & Regards*
*Hanish Bansal*

Re: Kafka Metrics in 0.8

Posted by Jun Rao <ju...@gmail.com>.
Does the Kafka data show up in the log dir in kafka-2? Since only the
leader can serve any traffic, if there is only have one partition or all
leaders are on one broker, not all metrics (e.g., produce/fetch rate) will
show up on both brokers.

Thanks,

Jun


On Mon, Jul 29, 2013 at 6:04 AM, Hanish Bansal <
hanish.bansal.agarwal@gmail.com> wrote:

> Hi All,
>
> As kafka-0.8's main feature in data replication.
>
> We are running two kafka nodes(lets say: kafka-1 and kafka-2) in cluster
> mode. If we produce data into kafka using replication factor=2 then its
> replica is created on second machine.
>
> I am using jconsole to monitor kafka. if messages are going on kafka-1 then
> i am able to see kafka metrics on jconsole of kafka-1. But by connecting to
> jconsole for kafka-2 i am not seeing any metrics, i want to know why it is
> happening ??
>
> For more clarity i am asking same question in other way:
> If one kafka node is storing replicas of data, then will it be visible on
> jconsole or not ?
>
>
>
>
>
>
> On Wed, Jul 3, 2013 at 1:06 PM, Hanish Bansal <
> hanish.bansal.agarwal@gmail.com> wrote:
>
> > Thanks Jun
> >
> >
> > On Tue, Jul 2, 2013 at 2:35 PM, Jun Rao <ju...@gmail.com> wrote:
> >
> >> In 0.8, there are more mbeans than 0.7.
> >>
> >> Thanks,
> >>
> >> Jun
> >>
> >>
> >> On Mon, Jul 1, 2013 at 9:06 PM, Hanish Bansal <
> >> hanish.bansal.agarwal@gmail.com> wrote:
> >>
> >> > Okay i'll try for same.
> >> >
> >> > Also want to know that in kafka-0.7 there is single MBean -
> >> > SocketServerStats which provides all kafka Metrics. But in Kafka-0-8
> >> there
> >> > are individual MBeans (like AllTopicsBytesInPerSec,
> >> AllTopicsBytesOutPerSec
> >> > etc.) for getting each parameter like ByteInRate, ByteOutRate etc.
> >> >
> >> > Does kafka-0.8 provide any single MBean from which we can get all
> >> > parameters?
> >> >
> >> >
> >> >
> >> >
> >> > On Mon, Jul 1, 2013 at 3:47 PM, Jun Rao <ju...@gmail.com> wrote:
> >> >
> >> > > It seems that the mbean name that you used is wrong. The mbean names
> >> > > registered by metrics 2.2.0 have quotes in them.
> >> > >
> >> > > Thanks,
> >> > >
> >> > > Jun
> >> > >
> >> > >
> >> > > On Mon, Jul 1, 2013 at 4:31 AM, Hanish Bansal <
> >> > > hanish.bansal.agarwal@gmail.com> wrote:
> >> > >
> >> > > > Hi
> >> > > >
> >> > > > I am getting various kafka parameters (like NumFetchRequests,
> >> > > > FetchRequestsPerSecond, ProduceRequestsPerSecond etc.) through JMX
> >> in
> >> > > case
> >> > > > of kafka-0.7.
> >> > > >
> >> > > > In kafka-0.8 i am doing the same but not able to get parameters.
> >> > > >
> >> > > > There are some changes in reporting metrics in kafka-0.8 as
> >> compared to
> >> > > > kafka-0.7. I have already noticed that. According to changes in
> >> > > kafka-0.8 i
> >> > > > am trying to get kafka metrics using JMX through jmxtrans api.
> >> > > >
> >> > > > Here is sample java code of getting jmx parameters using jmxtrans
> >> api:
> >> > > >
> >> > > >        Server kafkaJMXServer = new Server("127.0.0.1", "9999");
> >> > > >         Query query1 = new Query();
> >> > > >
> >> > > >
> >> > > >
> >> > >
> >> >
> >>
> query1.setObj("kafka.server:type=BrokerTopicMetrics,name=AllTopicsBytesInPerSec");
> >> > > >         query1.addAttr("MeanRate");
> >> > > >         kafkaJMXServer.addQuery(query1);
> >> > > >         JmxProcess process = new JmxProcess(kafkaJMXServer);
> >> > > >         JmxUtils.execute(process);
> >> > > >         System.out.println(query1.getResults());
> >> > > >
> >> > > > Please let me know what i am missing?
> >> > > >
> >> > > > --
> >> > > > *Thanks & Regards*
> >> > > > *Hanish Bansal*
> >> > > >
> >> > >
> >> >
> >> >
> >> >
> >> > --
> >> > *Thanks & Regards*
> >> > *Hanish Bansal*
> >> >
> >>
> >
> >
> >
> > --
> > *Thanks & Regards*
> > *Hanish Bansal*
> >
>
>
>
> --
> *Thanks & Regards*
> *Hanish Bansal*
>

Re: Kafka Metrics in 0.8

Posted by Hanish Bansal <ha...@gmail.com>.
Hi All,

As kafka-0.8's main feature in data replication.

We are running two kafka nodes(lets say: kafka-1 and kafka-2) in cluster
mode. If we produce data into kafka using replication factor=2 then its
replica is created on second machine.

I am using jconsole to monitor kafka. if messages are going on kafka-1 then
i am able to see kafka metrics on jconsole of kafka-1. But by connecting to
jconsole for kafka-2 i am not seeing any metrics, i want to know why it is
happening ??

For more clarity i am asking same question in other way:
If one kafka node is storing replicas of data, then will it be visible on
jconsole or not ?






On Wed, Jul 3, 2013 at 1:06 PM, Hanish Bansal <
hanish.bansal.agarwal@gmail.com> wrote:

> Thanks Jun
>
>
> On Tue, Jul 2, 2013 at 2:35 PM, Jun Rao <ju...@gmail.com> wrote:
>
>> In 0.8, there are more mbeans than 0.7.
>>
>> Thanks,
>>
>> Jun
>>
>>
>> On Mon, Jul 1, 2013 at 9:06 PM, Hanish Bansal <
>> hanish.bansal.agarwal@gmail.com> wrote:
>>
>> > Okay i'll try for same.
>> >
>> > Also want to know that in kafka-0.7 there is single MBean -
>> > SocketServerStats which provides all kafka Metrics. But in Kafka-0-8
>> there
>> > are individual MBeans (like AllTopicsBytesInPerSec,
>> AllTopicsBytesOutPerSec
>> > etc.) for getting each parameter like ByteInRate, ByteOutRate etc.
>> >
>> > Does kafka-0.8 provide any single MBean from which we can get all
>> > parameters?
>> >
>> >
>> >
>> >
>> > On Mon, Jul 1, 2013 at 3:47 PM, Jun Rao <ju...@gmail.com> wrote:
>> >
>> > > It seems that the mbean name that you used is wrong. The mbean names
>> > > registered by metrics 2.2.0 have quotes in them.
>> > >
>> > > Thanks,
>> > >
>> > > Jun
>> > >
>> > >
>> > > On Mon, Jul 1, 2013 at 4:31 AM, Hanish Bansal <
>> > > hanish.bansal.agarwal@gmail.com> wrote:
>> > >
>> > > > Hi
>> > > >
>> > > > I am getting various kafka parameters (like NumFetchRequests,
>> > > > FetchRequestsPerSecond, ProduceRequestsPerSecond etc.) through JMX
>> in
>> > > case
>> > > > of kafka-0.7.
>> > > >
>> > > > In kafka-0.8 i am doing the same but not able to get parameters.
>> > > >
>> > > > There are some changes in reporting metrics in kafka-0.8 as
>> compared to
>> > > > kafka-0.7. I have already noticed that. According to changes in
>> > > kafka-0.8 i
>> > > > am trying to get kafka metrics using JMX through jmxtrans api.
>> > > >
>> > > > Here is sample java code of getting jmx parameters using jmxtrans
>> api:
>> > > >
>> > > >        Server kafkaJMXServer = new Server("127.0.0.1", "9999");
>> > > >         Query query1 = new Query();
>> > > >
>> > > >
>> > > >
>> > >
>> >
>> query1.setObj("kafka.server:type=BrokerTopicMetrics,name=AllTopicsBytesInPerSec");
>> > > >         query1.addAttr("MeanRate");
>> > > >         kafkaJMXServer.addQuery(query1);
>> > > >         JmxProcess process = new JmxProcess(kafkaJMXServer);
>> > > >         JmxUtils.execute(process);
>> > > >         System.out.println(query1.getResults());
>> > > >
>> > > > Please let me know what i am missing?
>> > > >
>> > > > --
>> > > > *Thanks & Regards*
>> > > > *Hanish Bansal*
>> > > >
>> > >
>> >
>> >
>> >
>> > --
>> > *Thanks & Regards*
>> > *Hanish Bansal*
>> >
>>
>
>
>
> --
> *Thanks & Regards*
> *Hanish Bansal*
>



-- 
*Thanks & Regards*
*Hanish Bansal*

Re: Kafka Metrics in 0.8

Posted by Hanish Bansal <ha...@gmail.com>.
Thanks Jun


On Tue, Jul 2, 2013 at 2:35 PM, Jun Rao <ju...@gmail.com> wrote:

> In 0.8, there are more mbeans than 0.7.
>
> Thanks,
>
> Jun
>
>
> On Mon, Jul 1, 2013 at 9:06 PM, Hanish Bansal <
> hanish.bansal.agarwal@gmail.com> wrote:
>
> > Okay i'll try for same.
> >
> > Also want to know that in kafka-0.7 there is single MBean -
> > SocketServerStats which provides all kafka Metrics. But in Kafka-0-8
> there
> > are individual MBeans (like AllTopicsBytesInPerSec,
> AllTopicsBytesOutPerSec
> > etc.) for getting each parameter like ByteInRate, ByteOutRate etc.
> >
> > Does kafka-0.8 provide any single MBean from which we can get all
> > parameters?
> >
> >
> >
> >
> > On Mon, Jul 1, 2013 at 3:47 PM, Jun Rao <ju...@gmail.com> wrote:
> >
> > > It seems that the mbean name that you used is wrong. The mbean names
> > > registered by metrics 2.2.0 have quotes in them.
> > >
> > > Thanks,
> > >
> > > Jun
> > >
> > >
> > > On Mon, Jul 1, 2013 at 4:31 AM, Hanish Bansal <
> > > hanish.bansal.agarwal@gmail.com> wrote:
> > >
> > > > Hi
> > > >
> > > > I am getting various kafka parameters (like NumFetchRequests,
> > > > FetchRequestsPerSecond, ProduceRequestsPerSecond etc.) through JMX in
> > > case
> > > > of kafka-0.7.
> > > >
> > > > In kafka-0.8 i am doing the same but not able to get parameters.
> > > >
> > > > There are some changes in reporting metrics in kafka-0.8 as compared
> to
> > > > kafka-0.7. I have already noticed that. According to changes in
> > > kafka-0.8 i
> > > > am trying to get kafka metrics using JMX through jmxtrans api.
> > > >
> > > > Here is sample java code of getting jmx parameters using jmxtrans
> api:
> > > >
> > > >        Server kafkaJMXServer = new Server("127.0.0.1", "9999");
> > > >         Query query1 = new Query();
> > > >
> > > >
> > > >
> > >
> >
> query1.setObj("kafka.server:type=BrokerTopicMetrics,name=AllTopicsBytesInPerSec");
> > > >         query1.addAttr("MeanRate");
> > > >         kafkaJMXServer.addQuery(query1);
> > > >         JmxProcess process = new JmxProcess(kafkaJMXServer);
> > > >         JmxUtils.execute(process);
> > > >         System.out.println(query1.getResults());
> > > >
> > > > Please let me know what i am missing?
> > > >
> > > > --
> > > > *Thanks & Regards*
> > > > *Hanish Bansal*
> > > >
> > >
> >
> >
> >
> > --
> > *Thanks & Regards*
> > *Hanish Bansal*
> >
>



-- 
*Thanks & Regards*
*Hanish Bansal*

Re: Kafka Metrics in 0.8

Posted by Jun Rao <ju...@gmail.com>.
In 0.8, there are more mbeans than 0.7.

Thanks,

Jun


On Mon, Jul 1, 2013 at 9:06 PM, Hanish Bansal <
hanish.bansal.agarwal@gmail.com> wrote:

> Okay i'll try for same.
>
> Also want to know that in kafka-0.7 there is single MBean -
> SocketServerStats which provides all kafka Metrics. But in Kafka-0-8 there
> are individual MBeans (like AllTopicsBytesInPerSec, AllTopicsBytesOutPerSec
> etc.) for getting each parameter like ByteInRate, ByteOutRate etc.
>
> Does kafka-0.8 provide any single MBean from which we can get all
> parameters?
>
>
>
>
> On Mon, Jul 1, 2013 at 3:47 PM, Jun Rao <ju...@gmail.com> wrote:
>
> > It seems that the mbean name that you used is wrong. The mbean names
> > registered by metrics 2.2.0 have quotes in them.
> >
> > Thanks,
> >
> > Jun
> >
> >
> > On Mon, Jul 1, 2013 at 4:31 AM, Hanish Bansal <
> > hanish.bansal.agarwal@gmail.com> wrote:
> >
> > > Hi
> > >
> > > I am getting various kafka parameters (like NumFetchRequests,
> > > FetchRequestsPerSecond, ProduceRequestsPerSecond etc.) through JMX in
> > case
> > > of kafka-0.7.
> > >
> > > In kafka-0.8 i am doing the same but not able to get parameters.
> > >
> > > There are some changes in reporting metrics in kafka-0.8 as compared to
> > > kafka-0.7. I have already noticed that. According to changes in
> > kafka-0.8 i
> > > am trying to get kafka metrics using JMX through jmxtrans api.
> > >
> > > Here is sample java code of getting jmx parameters using jmxtrans api:
> > >
> > >        Server kafkaJMXServer = new Server("127.0.0.1", "9999");
> > >         Query query1 = new Query();
> > >
> > >
> > >
> >
> query1.setObj("kafka.server:type=BrokerTopicMetrics,name=AllTopicsBytesInPerSec");
> > >         query1.addAttr("MeanRate");
> > >         kafkaJMXServer.addQuery(query1);
> > >         JmxProcess process = new JmxProcess(kafkaJMXServer);
> > >         JmxUtils.execute(process);
> > >         System.out.println(query1.getResults());
> > >
> > > Please let me know what i am missing?
> > >
> > > --
> > > *Thanks & Regards*
> > > *Hanish Bansal*
> > >
> >
>
>
>
> --
> *Thanks & Regards*
> *Hanish Bansal*
>

Re: Kafka Metrics in 0.8

Posted by Hanish Bansal <ha...@gmail.com>.
Okay i'll try for same.

Also want to know that in kafka-0.7 there is single MBean -
SocketServerStats which provides all kafka Metrics. But in Kafka-0-8 there
are individual MBeans (like AllTopicsBytesInPerSec, AllTopicsBytesOutPerSec
etc.) for getting each parameter like ByteInRate, ByteOutRate etc.

Does kafka-0.8 provide any single MBean from which we can get all
parameters?




On Mon, Jul 1, 2013 at 3:47 PM, Jun Rao <ju...@gmail.com> wrote:

> It seems that the mbean name that you used is wrong. The mbean names
> registered by metrics 2.2.0 have quotes in them.
>
> Thanks,
>
> Jun
>
>
> On Mon, Jul 1, 2013 at 4:31 AM, Hanish Bansal <
> hanish.bansal.agarwal@gmail.com> wrote:
>
> > Hi
> >
> > I am getting various kafka parameters (like NumFetchRequests,
> > FetchRequestsPerSecond, ProduceRequestsPerSecond etc.) through JMX in
> case
> > of kafka-0.7.
> >
> > In kafka-0.8 i am doing the same but not able to get parameters.
> >
> > There are some changes in reporting metrics in kafka-0.8 as compared to
> > kafka-0.7. I have already noticed that. According to changes in
> kafka-0.8 i
> > am trying to get kafka metrics using JMX through jmxtrans api.
> >
> > Here is sample java code of getting jmx parameters using jmxtrans api:
> >
> >        Server kafkaJMXServer = new Server("127.0.0.1", "9999");
> >         Query query1 = new Query();
> >
> >
> >
> query1.setObj("kafka.server:type=BrokerTopicMetrics,name=AllTopicsBytesInPerSec");
> >         query1.addAttr("MeanRate");
> >         kafkaJMXServer.addQuery(query1);
> >         JmxProcess process = new JmxProcess(kafkaJMXServer);
> >         JmxUtils.execute(process);
> >         System.out.println(query1.getResults());
> >
> > Please let me know what i am missing?
> >
> > --
> > *Thanks & Regards*
> > *Hanish Bansal*
> >
>



-- 
*Thanks & Regards*
*Hanish Bansal*

Re: Kafka Metrics in 0.8

Posted by Jun Rao <ju...@gmail.com>.
It seems that the mbean name that you used is wrong. The mbean names
registered by metrics 2.2.0 have quotes in them.

Thanks,

Jun


On Mon, Jul 1, 2013 at 4:31 AM, Hanish Bansal <
hanish.bansal.agarwal@gmail.com> wrote:

> Hi
>
> I am getting various kafka parameters (like NumFetchRequests,
> FetchRequestsPerSecond, ProduceRequestsPerSecond etc.) through JMX in case
> of kafka-0.7.
>
> In kafka-0.8 i am doing the same but not able to get parameters.
>
> There are some changes in reporting metrics in kafka-0.8 as compared to
> kafka-0.7. I have already noticed that. According to changes in kafka-0.8 i
> am trying to get kafka metrics using JMX through jmxtrans api.
>
> Here is sample java code of getting jmx parameters using jmxtrans api:
>
>        Server kafkaJMXServer = new Server("127.0.0.1", "9999");
>         Query query1 = new Query();
>
>
> query1.setObj("kafka.server:type=BrokerTopicMetrics,name=AllTopicsBytesInPerSec");
>         query1.addAttr("MeanRate");
>         kafkaJMXServer.addQuery(query1);
>         JmxProcess process = new JmxProcess(kafkaJMXServer);
>         JmxUtils.execute(process);
>         System.out.println(query1.getResults());
>
> Please let me know what i am missing?
>
> --
> *Thanks & Regards*
> *Hanish Bansal*
>