You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@kafka.apache.org by Jose Manuel Vega Monroy <jo...@williamhill.com> on 2019/04/21 19:17:56 UTC
Re: [EXTERNAL] Re: Kafka - JMX Metrics for Fetch and Produce
Hi there,
Included "Bandwidth quota metrics per (user, client-id), user or client-id"?
That was the metric we were monitoring, with regex to show any user and clientId.
Thanks
<http://www.williamhill.com/>
<http://www.whenthefunstops.co.uk/>
Jose Manuel Vega Monroy
Java Developer / Software Developer Engineer in Test
Direct: +0035 0 2008038 (Ext. 8038)
Email: jose.monroy@williamhill.com
William Hill | 6/1 Waterport Place | Gibraltar | GX11 1AA
On 21/04/2019, 21:10, "Manikumar" <ma...@gmail.com> wrote:
Hi,
RequestsPerSec metric was changed to include the API version in Kafka 2.0
release.
You may need to update jmx query.
https://urldefense.proofpoint.com/v2/url?u=http-3A__kafka.apache.org_documentation_-23upgrade-5F200-5Fnotable&d=DwIBaQ&c=pWn2jKJ-j-AhxLuiRFe-Qw&r=i5Pk4pirVCmwsmddZqplM1jyQtVWeoOOb-vkuqku5P8&m=HpbvSUu37R0CDXVebPOpAiXnWZvMUBHNRztCp9xwf20&s=zZQcoInkTwcV58vNqte10APezEUrDt-GvCevjKeN_OE&e=
https://urldefense.proofpoint.com/v2/url?u=https-3A__cwiki.apache.org_confluence_display_KAFKA_KIP-2D272-253A-2BAdd-2BAPI-2Bversion-2Btag-2Bto-2Bbroker-2527s-2BRequestsPerSec-2Bmetric&d=DwIBaQ&c=pWn2jKJ-j-AhxLuiRFe-Qw&r=i5Pk4pirVCmwsmddZqplM1jyQtVWeoOOb-vkuqku5P8&m=HpbvSUu37R0CDXVebPOpAiXnWZvMUBHNRztCp9xwf20&s=s9z5arHWXznh1HdIQ4CTacRYCl885Ss84-LVkFSahro&e=
On Mon, Apr 22, 2019 at 12:23 AM Jose Manuel Vega Monroy <
jose.monroy@williamhill.com> wrote:
> Hi there,
>
>
>
> Recently I performed several * rolling upgrades following official steps*
> for our Kafka brokers *from 0.11.0.1 to newer versions in different
> environments*, and apparently working fine in all cases from functional
> point of view: *producers and consumers working as expected*.
>
>
>
> Specifically, I upgraded:
>
>
>
> 1. From *0.11.0.1 to 1.0.0*, and then from *1.0.0 to 2.0.0*, and then*
> to* *2.1.1*
> 2. *From 0.11.0.1 directly to 2.1.1*
>
>
>
> However, in all cases *JMX metrics for Fetch and Produce* which used to
> show *all producers and consumers working with brokers* are gone, just
> showing queue-size, in our *JMX monitoring clients* -specifically, *Introscope
> Wily*- keeping same configuration*.*
>
>
>
> In fact, I removed Wily filter configuration for JMX in *order to show
> all possible metrics, and keeping both Fetch and Produce still gone*.
>
>
>
> Note I checked if having proper version after rolling upgrade, for
> example, for *2.1.1*, and being as expected:
>
>
>
> *ll /opt/kafka/libs/*
>
> *total 54032*
>
> *-rw-r--r-- 1 kafka kafka 69409 Jan 4 08:42 activation-1.1.1.jar*
>
> *-rw-r--r-- 1 kafka kafka 14768 Jan 4 08:42
> aopalliance-repackaged-2.5.0-b42.jar*
>
> *-rw-r--r-- 1 kafka kafka 90347 Jan 4 08:42 argparse4j-0.7.0.jar*
>
> *-rw-r--r-- 1 kafka kafka 20437 Jan 4 08:40
> audience-annotations-0.5.0.jar*
>
> *-rw-r--r-- 1 kafka kafka 501879 Jan 4 08:43 commons-lang3-3.8.1.jar*
>
> *-rw-r--r-- 1 kafka kafka 96801 Feb 8 18:32 connect-api-2.1.1.jar*
>
> *-rw-r--r-- 1 kafka kafka 18265 Feb 8 18:32
> connect-basic-auth-extension-2.1.1.jar*
>
> *-rw-r--r-- 1 kafka kafka 20509 Feb 8 18:32 connect-file-2.1.1.jar*
>
> *-rw-r--r-- 1 kafka kafka 45489 Feb 8 18:32 connect-json-2.1.1.jar*
>
> *-rw-r--r-- 1 kafka kafka 466588 Feb 8 18:32 connect-runtime-2.1.1.jar*
>
> *-rw-r--r-- 1 kafka kafka 90358 Feb 8 18:32
> connect-transforms-2.1.1.jar*
>
> *-rw-r--r-- 1 kafka kafka 2442625 Jan 4 08:43 guava-20.0.jar*
>
> *-rw-r--r-- 1 kafka kafka 186763 Jan 4 08:42 hk2-api-2.5.0-b42.jar*
>
> *-rw-r--r-- 1 kafka kafka 189454 Jan 4 08:42 hk2-locator-2.5.0-b42.jar*
>
> *-rw-r--r-- 1 kafka kafka 135317 Jan 4 08:42 hk2-utils-2.5.0-b42.jar*
>
> *-rw-r--r-- 1 kafka kafka 66894 Jan 11 21:28
> jackson-annotations-2.9.8.jar*
>
> *-rw-r--r-- 1 kafka kafka 325619 Jan 11 21:27 jackson-core-2.9.8.jar*
>
> *-rw-r--r-- 1 kafka kafka 1347236 Jan 11 21:27 jackson-databind-2.9.8.jar*
>
> *-rw-r--r-- 1 kafka kafka 32373 Jan 11 21:28
> jackson-jaxrs-base-2.9.8.jar*
>
> *-rw-r--r-- 1 kafka kafka 15861 Jan 11 21:28
> jackson-jaxrs-json-provider-2.9.8.jar*
>
> *-rw-r--r-- 1 kafka kafka 32627 Jan 11 21:28
> jackson-module-jaxb-annotations-2.9.8.jar*
>
> *-rw-r--r-- 1 kafka kafka 737884 Jan 4 08:43 javassist-3.22.0-CR2.jar*
>
> *-rw-r--r-- 1 kafka kafka 26366 Jan 4 08:42
> javax.annotation-api-1.2.jar*
>
> *-rw-r--r-- 1 kafka kafka 2497 Jan 4 08:42 javax.inject-1.jar*
>
> *-rw-r--r-- 1 kafka kafka 5951 Jan 4 08:42 javax.inject-2.5.0-b42.jar*
>
> *-rw-r--r-- 1 kafka kafka 95806 Jan 4 08:42
> javax.servlet-api-3.1.0.jar*
>
> *-rw-r--r-- 1 kafka kafka 126898 Jan 4 08:42 javax.ws.rs-api-2.1.1.jar*
>
> *-rw-r--r-- 1 kafka kafka 127509 Jan 4 08:42 javax.ws.rs-api-2.1.jar*
>
> *-rw-r--r-- 1 kafka kafka 125632 Jan 4 08:42 jaxb-api-2.3.0.jar*
>
> *-rw-r--r-- 1 kafka kafka 181563 Jan 4 08:42 jersey-client-2.27.jar*
>
> *-rw-r--r-- 1 kafka kafka 1140395 Jan 4 08:43 jersey-common-2.27.jar*
>
> *-rw-r--r-- 1 kafka kafka 18085 Jan 4 08:42
> jersey-container-servlet-2.27.jar*
>
> *-rw-r--r-- 1 kafka kafka 59332 Jan 4 08:42
> jersey-container-servlet-core-2.27.jar*
>
> *-rw-r--r-- 1 kafka kafka 62547 Jan 4 08:42 jersey-hk2-2.27.jar*
>
> *-rw-r--r-- 1 kafka kafka 71936 Jan 4 08:42 jersey-media-jaxb-2.27.jar*
>
> *-rw-r--r-- 1 kafka kafka 933619 Jan 4 08:43 jersey-server-2.27.jar*
>
> *-rw-r--r-- 1 kafka kafka 280573 Jan 4 08:43
> jetty-client-9.4.12.v20180830.jar*
>
> *-rw-r--r-- 1 kafka kafka 16680 Jan 4 08:42
> jetty-continuation-9.4.12.v20180830.jar*
>
> *-rw-r--r-- 1 kafka kafka 195664 Jan 4 08:42
> jetty-http-9.4.12.v20180830.jar*
>
> *-rw-r--r-- 1 kafka kafka 139436 Jan 4 08:42
> jetty-io-9.4.12.v20180830.jar*
>
> *-rw-r--r-- 1 kafka kafka 93077 Jan 4 08:42
> jetty-security-9.4.12.v20180830.jar*
>
> *-rw-r--r-- 1 kafka kafka 609290 Jan 4 08:43
> jetty-server-9.4.12.v20180830.jar*
>
> *-rw-r--r-- 1 kafka kafka 110983 Jan 4 08:42
> jetty-servlet-9.4.12.v20180830.jar*
>
> *-rw-r--r-- 1 kafka kafka 93161 Jan 4 08:42
> jetty-servlets-9.4.12.v20180830.jar*
>
> *-rw-r--r-- 1 kafka kafka 502985 Jan 4 08:43
> jetty-util-9.4.12.v20180830.jar*
>
> *-rw-r--r-- 1 kafka kafka 78146 Jan 4 08:40 jopt-simple-5.0.4.jar*
>
> *-rw-r--r-- 1 kafka kafka 3949187 Feb 8 18:32 kafka_2.12-2.1.1.jar*
>
> *-rw-r--r-- 1 kafka kafka 821 Feb 8 18:32 kafka_2.12-2.1.1.jar.asc*
>
> *-rw-r--r-- 1 kafka kafka 31034 Feb 8 18:32
> kafka_2.12-2.1.1-javadoc.jar*
>
> *-rw-r--r-- 1 kafka kafka 821 Feb 8 18:32
> kafka_2.12-2.1.1-javadoc.jar.asc*
>
> *-rw-r--r-- 1 kafka kafka 10261 Feb 8 18:32
> kafka_2.12-2.1.1-scaladoc.jar*
>
> *-rw-r--r-- 1 kafka kafka 821 Feb 8 18:32
> kafka_2.12-2.1.1-scaladoc.jar.asc*
>
> *-rw-r--r-- 1 kafka kafka 728679 Feb 8 18:32
> kafka_2.12-2.1.1-sources.jar*
>
> *-rw-r--r-- 1 kafka kafka 821 Feb 8 18:32
> kafka_2.12-2.1.1-sources.jar.asc*
>
> *-rw-r--r-- 1 kafka kafka 2956429 Feb 8 18:32 kafka_2.12-2.1.1-test.jar*
>
> *-rw-r--r-- 1 kafka kafka 821 Feb 8 18:32
> kafka_2.12-2.1.1-test.jar.asc*
>
> *-rw-r--r-- 1 kafka kafka 740522 Feb 8 18:32
> kafka_2.12-2.1.1-test-sources.jar*
>
> *-rw-r--r-- 1 kafka kafka 821 Feb 8 18:32
> kafka_2.12-2.1.1-test-sources.jar.asc*
>
> *-rw-r--r-- 1 kafka kafka 1893108 Feb 8 18:31 kafka-clients-2.1.1.jar*
>
> *-rw-r--r-- 1 kafka kafka 14499 Feb 8 18:32
> kafka-log4j-appender-2.1.1.jar*
>
> *-rw-r--r-- 1 kafka kafka 871817 Feb 8 18:32 kafka-streams-2.1.1.jar*
>
> *-rw-r--r-- 1 kafka kafka 39331 Feb 8 18:32
> kafka-streams-examples-2.1.1.jar*
>
> *-rw-r--r-- 1 kafka kafka 170375 Feb 8 18:33
> kafka-streams-scala_2.12-2.1.1.jar*
>
> *-rw-r--r-- 1 kafka kafka 38309 Feb 8 18:32
> kafka-streams-test-utils-2.1.1.jar*
>
> *-rw-r--r-- 1 kafka kafka 328053 Feb 8 18:32 kafka-tools-2.1.1.jar*
>
> *-rw-r--r-- 1 kafka kafka 489884 Jan 4 08:39 log4j-1.2.17.jar*
>
> *-rw-r--r-- 1 kafka kafka 511547 Jan 4 08:39 lz4-java-1.5.0.jar*
>
> *-rw-r--r-- 1 kafka kafka 55051 Jan 4 08:43 maven-artifact-3.6.0.jar*
>
> *-rw-r--r-- 1 kafka kafka 82123 Jan 4 08:40 metrics-core-2.2.0.jar*
>
> *-rw-r--r-- 1 kafka kafka 20235 Jan 4 08:42
> osgi-resource-locator-1.0.1.jar*
>
> *-rw-r--r-- 1 kafka kafka 261617 Jan 4 08:43 plexus-utils-3.1.0.jar*
>
> *-rw-r--r-- 1 kafka kafka 130999 Jan 4 08:43 reflections-0.9.11.jar*
>
> *-rw-r--r-- 1 kafka kafka 13908249 Jan 7 19:26 rocksdbjni-5.14.2.jar*
>
> *-rw-r--r-- 1 kafka kafka 5277511 Jan 4 08:40 scala-library-2.12.7.jar*
>
> *-rw-r--r-- 1 kafka kafka 54709 Jan 4 08:40
> scala-logging_2.12-3.9.0.jar*
>
> *-rw-r--r-- 1 kafka kafka 3616372 Jan 4 08:40 scala-reflect-2.12.7.jar*
>
> *-rw-r--r-- 1 kafka kafka 41203 Jan 4 08:36 slf4j-api-1.7.25.jar*
>
> *-rw-r--r-- 1 kafka kafka 12244 Jan 4 08:39 slf4j-log4j12-1.7.25.jar*
>
> *-rw-r--r-- 1 kafka kafka 2018686 Jan 4 08:39 snappy-java-1.1.7.2.jar*
>
> *-rw-r--r-- 1 kafka kafka 63777 Jan 4 08:42
> validation-api-1.1.0.Final.jar*
>
> *-rw-r--r-- 1 kafka kafka 74626 Jan 4 08:40 zkclient-0.11.jar*
>
> *-rw-r--r-- 1 kafka kafka 906708 Jan 4 08:40 zookeeper-3.4.13.jar*
>
> *-rw-r--r-- 1 kafka kafka 3810541 Jan 4 08:39 zstd-jni-1.3.7-1.jar*
>
>
>
> Any idea why is this happening? Maybe upgrade was wrong? Maybe related to
> any broker missconfiguration?
>
>
>
> Thanks
>
>
>
> [image:
> https://urldefense.proofpoint.com/v2/url?u=https-3A__www.williamhillplc.com_content_signature_WHlogo.gif-3Fwidth-3D180&d=DwIBaQ&c=pWn2jKJ-j-AhxLuiRFe-Qw&r=i5Pk4pirVCmwsmddZqplM1jyQtVWeoOOb-vkuqku5P8&m=HpbvSUu37R0CDXVebPOpAiXnWZvMUBHNRztCp9xwf20&s=88hcpTdq6y5QSvidvnHFI4M9rgejnRKX1R7WX3myz-8&e=]
> <http://www.williamhill.com/>
>
> [image:
> https://urldefense.proofpoint.com/v2/url?u=https-3A__www.williamhillplc.com_content_signature_senet.gif-3Fwidth-3D180&d=DwIBaQ&c=pWn2jKJ-j-AhxLuiRFe-Qw&r=i5Pk4pirVCmwsmddZqplM1jyQtVWeoOOb-vkuqku5P8&m=HpbvSUu37R0CDXVebPOpAiXnWZvMUBHNRztCp9xwf20&s=CZxI13aAW3RT5wJ4ppBnRF-1-tGSmY0AInL1m6UDgvc&e=]
> <https://urldefense.proofpoint.com/v2/url?u=http-3A__www.whenthefunstops.co.uk_&d=DwIBaQ&c=pWn2jKJ-j-AhxLuiRFe-Qw&r=i5Pk4pirVCmwsmddZqplM1jyQtVWeoOOb-vkuqku5P8&m=HpbvSUu37R0CDXVebPOpAiXnWZvMUBHNRztCp9xwf20&s=YxlQYhmbaD4KtWSeq3cW0xWJKOuhPKoiyAYsGP166n0&e=>
>
> *Jose Manuel Vega Monroy *
> *Java Developer / Software Developer Engineer in Test*
>
> Direct: +*0035 0 2008038 (Ext. 8038)*
> Email: jose.monroy@williamhill.com
>
> William Hill | 6/1 Waterport Place | Gibraltar | GX11 1AA
>
>
>
>
>
>
>