You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@kafka.apache.org by Xinyi Su <xi...@gmail.com> on 2015/02/05 11:25:48 UTC
Not found NewShinyProducer sync performance metrics
Hi,
I am using kafka-producer-perf-test.sh to study NewShinyProducer *sync*
performance.
I have not found any CSV output or metrics collector for NewShinyProducer
sync performance.
Would you like to share with me about how to collect NewShinyProducer
metrics?
Thanks.
Best regards.
Xinyi
Re: Not found NewShinyProducer sync performance metrics
Posted by Manikumar Reddy <ku...@nmsworks.co.in>.
You can configure the jmx ports by using below system properties.
-Dcom.sun.management.jmxremote.port=8888
-Dcom.sun.management.jmxremote.rmi.port=8889
On Fri, Feb 6, 2015 at 9:19 AM, Xinyi Su <xi...@gmail.com> wrote:
> Hi,
>
> I try to use Jconsole to connect remote Kafka broker which is running
> behind a firewall. But it is blocked by the firewall.
>
> I can specify JMX registry port by set JMX_PORT=xxxx which is allowed by
> firewall, but I cannot specify the "ephemeral" port which is always chosen
> randomly at startup. This ephemeral port is which JMX RMI server listens on
> and through which actual data exchange takes place. It is randomly assigned
> and I have no way to specify it as some port which firewall does not block.
>
> How to solve this issue since I cannot access Jconsole because of firewall?
>
> Thanks.
> Xinyi
>
> On 6 February 2015 at 07:24, Otis Gospodnetic <ot...@gmail.com>
> wrote:
>
> > Not announced yet, but http://sematext.com/spm should be showing you all
> > the new shiny Kafka (new producer) metrics out of the box. If you don't
> > see them, please shout (I know we have a bit more tweaking to do in the
> > coming day-two-three).
> >
> > If you want to just dump MBeans from JMX manually and eyeball the output,
> > you could use something like https://github.com/sematext/jmxc to dump
> the
> > whole JMX content of your Java Consumer, Producer, or Broker.
> >
> > Otis
> > --
> > Monitoring * Alerting * Anomaly Detection * Centralized Log Management
> > Solr & Elasticsearch Support * http://sematext.com/
> >
> >
> > On Thu, Feb 5, 2015 at 5:58 AM, Manikumar Reddy <ku...@nmsworks.co.in>
> > wrote:
> >
> > > New Producer uses Kafka's own metrics api. Currently metrics are
> reported
> > > using jmx. Any jmx monitoring tool (jconsole) can be used for
> monitoring.
> > > On Feb 5, 2015 3:56 PM, "Xinyi Su" <xi...@gmail.com> wrote:
> > >
> > > > Hi,
> > > > I am using kafka-producer-perf-test.sh to study NewShinyProducer
> *sync*
> > > > performance.
> > > >
> > > > I have not found any CSV output or metrics collector for
> > NewShinyProducer
> > > > sync performance.
> > > >
> > > > Would you like to share with me about how to collect NewShinyProducer
> > > > metrics?
> > > >
> > > > Thanks.
> > > >
> > > > Best regards.
> > > > Xinyi
> > > >
> > >
> >
>
Re: Not found NewShinyProducer sync performance metrics
Posted by Xinyi Su <xi...@gmail.com>.
Hi,
I try to use Jconsole to connect remote Kafka broker which is running
behind a firewall. But it is blocked by the firewall.
I can specify JMX registry port by set JMX_PORT=xxxx which is allowed by
firewall, but I cannot specify the "ephemeral" port which is always chosen
randomly at startup. This ephemeral port is which JMX RMI server listens on
and through which actual data exchange takes place. It is randomly assigned
and I have no way to specify it as some port which firewall does not block.
How to solve this issue since I cannot access Jconsole because of firewall?
Thanks.
Xinyi
On 6 February 2015 at 07:24, Otis Gospodnetic <ot...@gmail.com>
wrote:
> Not announced yet, but http://sematext.com/spm should be showing you all
> the new shiny Kafka (new producer) metrics out of the box. If you don't
> see them, please shout (I know we have a bit more tweaking to do in the
> coming day-two-three).
>
> If you want to just dump MBeans from JMX manually and eyeball the output,
> you could use something like https://github.com/sematext/jmxc to dump the
> whole JMX content of your Java Consumer, Producer, or Broker.
>
> Otis
> --
> Monitoring * Alerting * Anomaly Detection * Centralized Log Management
> Solr & Elasticsearch Support * http://sematext.com/
>
>
> On Thu, Feb 5, 2015 at 5:58 AM, Manikumar Reddy <ku...@nmsworks.co.in>
> wrote:
>
> > New Producer uses Kafka's own metrics api. Currently metrics are reported
> > using jmx. Any jmx monitoring tool (jconsole) can be used for monitoring.
> > On Feb 5, 2015 3:56 PM, "Xinyi Su" <xi...@gmail.com> wrote:
> >
> > > Hi,
> > > I am using kafka-producer-perf-test.sh to study NewShinyProducer *sync*
> > > performance.
> > >
> > > I have not found any CSV output or metrics collector for
> NewShinyProducer
> > > sync performance.
> > >
> > > Would you like to share with me about how to collect NewShinyProducer
> > > metrics?
> > >
> > > Thanks.
> > >
> > > Best regards.
> > > Xinyi
> > >
> >
>
Re: Not found NewShinyProducer sync performance metrics
Posted by Otis Gospodnetic <ot...@gmail.com>.
Not announced yet, but http://sematext.com/spm should be showing you all
the new shiny Kafka (new producer) metrics out of the box. If you don't
see them, please shout (I know we have a bit more tweaking to do in the
coming day-two-three).
If you want to just dump MBeans from JMX manually and eyeball the output,
you could use something like https://github.com/sematext/jmxc to dump the
whole JMX content of your Java Consumer, Producer, or Broker.
Otis
--
Monitoring * Alerting * Anomaly Detection * Centralized Log Management
Solr & Elasticsearch Support * http://sematext.com/
On Thu, Feb 5, 2015 at 5:58 AM, Manikumar Reddy <ku...@nmsworks.co.in>
wrote:
> New Producer uses Kafka's own metrics api. Currently metrics are reported
> using jmx. Any jmx monitoring tool (jconsole) can be used for monitoring.
> On Feb 5, 2015 3:56 PM, "Xinyi Su" <xi...@gmail.com> wrote:
>
> > Hi,
> > I am using kafka-producer-perf-test.sh to study NewShinyProducer *sync*
> > performance.
> >
> > I have not found any CSV output or metrics collector for NewShinyProducer
> > sync performance.
> >
> > Would you like to share with me about how to collect NewShinyProducer
> > metrics?
> >
> > Thanks.
> >
> > Best regards.
> > Xinyi
> >
>
Re: Not found NewShinyProducer sync performance metrics
Posted by Manikumar Reddy <ku...@nmsworks.co.in>.
New Producer uses Kafka's own metrics api. Currently metrics are reported
using jmx. Any jmx monitoring tool (jconsole) can be used for monitoring.
On Feb 5, 2015 3:56 PM, "Xinyi Su" <xi...@gmail.com> wrote:
> Hi,
> I am using kafka-producer-perf-test.sh to study NewShinyProducer *sync*
> performance.
>
> I have not found any CSV output or metrics collector for NewShinyProducer
> sync performance.
>
> Would you like to share with me about how to collect NewShinyProducer
> metrics?
>
> Thanks.
>
> Best regards.
> Xinyi
>