You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@kafka.apache.org by "Sujay Hegde (Jira)" <ji...@apache.org> on 2020/03/15 06:58:00 UTC

[jira] [Commented] (KAFKA-9660) KAFKA-1 build a kafka-exporter by java

    [ https://issues.apache.org/jira/browse/KAFKA-9660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17059561#comment-17059561 ] 

Sujay Hegde commented on KAFKA-9660:
------------------------------------

[~youlixishi],

 

Im interested.
Lets sync up and discuss

>  KAFKA-1 build a kafka-exporter by java
> ---------------------------------------
>
>                 Key: KAFKA-9660
>                 URL: https://issues.apache.org/jira/browse/KAFKA-9660
>             Project: Kafka
>          Issue Type: Improvement
>          Components: admin, metrics
>    Affects Versions: 0.10.2.0, 1.1.0, 2.0.0
>         Environment: java8+
>            Reporter: francis lee
>            Priority: Major
>              Labels: newbie
>
> [KIP-575|https://cwiki.apache.org/confluence/display/KAFKA/KIP-575%3A+build+a+Kafka-Exporter+by+Java]
> kafka is an excellent MQ running on JVM,  but no exporters JVMly. for a better future of  Kafka-Ecosystems
> the Apache needs a formal exporter like [https://github.com/apache/kafka-exporter].
> i wrote one for working, and hope to give to Apache. there are a lot of metric in JMX, it can be configed in the exporter-config.
>  
> if you are interested in it , join me!
> if you are interested in it , join me!
> if you are interested in it , join me!
>  
> for some metric list here:
> kafka_AddPartitionsToTxn_50thPercentile
> kafka_AddPartitionsToTxn_95thPercentile
> kafka_AddPartitionsToTxn_999thPercentile
> kafka_AddPartitionsToTxn_99thPercentile
> kafka_AddPartitionsToTxn_Count
> kafka_AddPartitionsToTxn_Max
> kafka_AddPartitionsToTxn_Mean
> kafka_AddPartitionsToTxn_MeanRate
> kafka_AddPartitionsToTxn_Min
> kafka_AddPartitionsToTxn_OneMinuteRate
> kafka_AddPartitionsToTxn_StdDev
> kafka_BrokerTopicMetrics_BytesInPerSec_Count
> kafka_BrokerTopicMetrics_BytesInPerSec_MeanRate
> kafka_BrokerTopicMetrics_BytesInPerSec_OneMinuteRate
> kafka_BrokerTopicMetrics_BytesOutPerSec_Count
> kafka_BrokerTopicMetrics_BytesOutPerSec_MeanRate
> kafka_BrokerTopicMetrics_BytesOutPerSec_OneMinuteRate
> kafka_BrokerTopicMetrics_BytesRejectedPerSec_Count
> kafka_BrokerTopicMetrics_BytesRejectedPerSec_MeanRate
> kafka_BrokerTopicMetrics_BytesRejectedPerSec_OneMinuteRate
> kafka_BrokerTopicMetrics_FailedFetchRequestsPerSec_Count
> kafka_BrokerTopicMetrics_FailedFetchRequestsPerSec_MeanRate
> kafka_BrokerTopicMetrics_FailedFetchRequestsPerSec_OneMinuteRate
> kafka_BrokerTopicMetrics_FailedProduceRequestsPerSec_Count
> kafka_BrokerTopicMetrics_FailedProduceRequestsPerSec_MeanRate
> kafka_BrokerTopicMetrics_FailedProduceRequestsPerSec_OneMinuteRate
> kafka_BrokerTopicMetrics_MessagesInPerSec_Count
> kafka_BrokerTopicMetrics_MessagesInPerSec_MeanRate
> kafka_BrokerTopicMetrics_MessagesInPerSec_OneMinuteRate
> kafka_BrokerTopicMetrics_ProduceMessageConversionsPerSec_Count
> kafka_BrokerTopicMetrics_ProduceMessageConversionsPerSec_MeanRate
> kafka_BrokerTopicMetrics_ProduceMessageConversionsPerSec_OneMinuteRate
> kafka_BrokerTopicMetrics_ReplicationBytesInPerSec_Count
> kafka_BrokerTopicMetrics_ReplicationBytesInPerSec_MeanRate
> kafka_BrokerTopicMetrics_ReplicationBytesInPerSec_OneMinuteRate
> kafka_BrokerTopicMetrics_ReplicationBytesOutPerSec_Count
> kafka_BrokerTopicMetrics_ReplicationBytesOutPerSec_MeanRate
> kafka_BrokerTopicMetrics_ReplicationBytesOutPerSec_OneMinuteRate
> kafka_BrokerTopicMetrics_TotalFetchRequestsPerSec_Count
> kafka_BrokerTopicMetrics_TotalFetchRequestsPerSec_MeanRate
> kafka_BrokerTopicMetrics_TotalFetchRequestsPerSec_OneMinuteRate
> kafka_BrokerTopicMetrics_TotalProduceRequestsPerSec_Count
> kafka_BrokerTopicMetrics_TotalProduceRequestsPerSec_MeanRate
> kafka_BrokerTopicMetrics_TotalProduceRequestsPerSec_OneMinuteRate
> kafka_BytesInPerSec_Count
> kafka_BytesInPerSec_FifteenMinuteRate
> kafka_BytesInPerSec_FiveMinuteRate
> kafka_BytesInPerSec_MeanRate
> kafka_BytesInPerSec_OneMinuteRate
> kafka_BytesOutPerSec_Count
> kafka_BytesOutPerSec_FifteenMinuteRate
> kafka_BytesOutPerSec_FiveMinuteRate
> kafka_BytesOutPerSec_MeanRate
> kafka_BytesOutPerSec_OneMinuteRate
> kafka_BytesRejectedPerSec_Count
> kafka_BytesRejectedPerSec_FifteenMinuteRate
> kafka_BytesRejectedPerSec_FiveMinuteRate
> kafka_BytesRejectedPerSec_MeanRate
> kafka_BytesRejectedPerSec_OneMinuteRate
> kafka_CreatePartitions_50thPercentile
> kafka_CreatePartitions_95thPercentile
> kafka_CreatePartitions_999thPercentile
> kafka_CreatePartitions_99thPercentile
> kafka_CreatePartitions_Count
> kafka_CreatePartitions_Max
> kafka_CreatePartitions_Mean
> kafka_CreatePartitions_MeanRate
> kafka_CreatePartitions_Min
> kafka_CreatePartitions_OneMinuteRate
> kafka_CreatePartitions_StdDev
> kafka_CreateTopics_50thPercentile
> kafka_CreateTopics_95thPercentile
> kafka_CreateTopics_999thPercentile
> kafka_CreateTopics_99thPercentile
> kafka_CreateTopics_Count
> kafka_CreateTopics_Max
> kafka_CreateTopics_Mean
> kafka_CreateTopics_MeanRate
> kafka_CreateTopics_Min
> kafka_CreateTopics_OneMinuteRate
> kafka_CreateTopics_StdDev
> kafka_DeleteGroups_50thPercentile
> kafka_DeleteGroups_95thPercentile
> kafka_DeleteGroups_999thPercentile
> kafka_DeleteGroups_99thPercentile
> kafka_DeleteGroups_Count
> kafka_DeleteGroups_Max
> kafka_DeleteGroups_Mean
> kafka_DeleteGroups_Min
> kafka_DeleteGroups_StdDev
> kafka_DeleteTopics_50thPercentile
> kafka_DeleteTopics_95thPercentile
> kafka_DeleteTopics_999thPercentile
> kafka_DeleteTopics_99thPercentile
> kafka_DeleteTopics_Count
> kafka_DeleteTopics_Max
> kafka_DeleteTopics_Mean
> kafka_DeleteTopics_MeanRate
> kafka_DeleteTopics_Min
> kafka_DeleteTopics_OneMinuteRate
> kafka_DeleteTopics_StdDev
> kafka_DescribeGroups_50thPercentile
> kafka_DescribeGroups_95thPercentile
> kafka_DescribeGroups_999thPercentile
> kafka_DescribeGroups_99thPercentile
> kafka_DescribeGroups_Count
> kafka_DescribeGroups_Max
> kafka_DescribeGroups_Mean
> kafka_DescribeGroups_MeanRate
> kafka_DescribeGroups_Min
> kafka_DescribeGroups_OneMinuteRate
> kafka_DescribeGroups_StdDev
> kafka_FailedFetchRequestsPerSec_Count
> kafka_FailedFetchRequestsPerSec_FifteenMinuteRate
> kafka_FailedFetchRequestsPerSec_FiveMinuteRate
> kafka_FailedFetchRequestsPerSec_MeanRate
> kafka_FailedFetchRequestsPerSec_OneMinuteRate
> kafka_FailedProduceRequestsPerSec_Count
> kafka_FailedProduceRequestsPerSec_FifteenMinuteRate
> kafka_FailedProduceRequestsPerSec_FiveMinuteRate
> kafka_FailedProduceRequestsPerSec_MeanRate
> kafka_FailedProduceRequestsPerSec_OneMinuteRate
> kafka_FetchConsumer_50thPercentile
> kafka_FetchConsumer_95thPercentile
> kafka_FetchConsumer_999thPercentile
> kafka_FetchConsumer_99thPercentile
> kafka_FetchConsumer_Count
> kafka_FetchConsumer_Max
> kafka_FetchConsumer_Mean
> kafka_FetchConsumer_MeanRate
> kafka_FetchConsumer_Min
> kafka_FetchConsumer_OneMinuteRate
> kafka_FetchConsumer_StdDev
> kafka_FetchFollower_50thPercentile
> kafka_FetchFollower_95thPercentile
> kafka_FetchFollower_999thPercentile
> kafka_FetchFollower_99thPercentile
> kafka_FetchFollower_Count
> kafka_FetchFollower_Max
> kafka_FetchFollower_Mean
> kafka_FetchFollower_MeanRate
> kafka_FetchFollower_Min
> kafka_FetchFollower_OneMinuteRate
> kafka_FetchFollower_StdDev
> kafka_FetchMessageConversionsPerSec_Count
> kafka_FetchMessageConversionsPerSec_FifteenMinuteRate
> kafka_FetchMessageConversionsPerSec_FiveMinuteRate
> kafka_FetchMessageConversionsPerSec_MeanRate
> kafka_FetchMessageConversionsPerSec_OneMinuteRate
> kafka_Fetch_50thPercentile
> kafka_Fetch_95thPercentile
> kafka_Fetch_999thPercentile
> kafka_Fetch_99thPercentile
> kafka_Fetch_Count
> kafka_Fetch_Max
> kafka_Fetch_Mean
> kafka_Fetch_MeanRate
> kafka_Fetch_Min
> kafka_Fetch_OneMinuteRate
> kafka_Fetch_StdDev
> kafka_FindCoordinator_50thPercentile
> kafka_FindCoordinator_95thPercentile
> kafka_FindCoordinator_999thPercentile
> kafka_FindCoordinator_99thPercentile
> kafka_FindCoordinator_Count
> kafka_FindCoordinator_Max
> kafka_FindCoordinator_Mean
> kafka_FindCoordinator_MeanRate
> kafka_FindCoordinator_Min
> kafka_FindCoordinator_OneMinuteRate
> kafka_FindCoordinator_StdDev
> kafka_G1_Old_Generation_CollectionCount
> kafka_G1_Old_Generation_CollectionTime
> kafka_G1_Young_Generation_CollectionCount
> kafka_G1_Young_Generation_CollectionTime
> kafka_GarbageCollector_G1_Old_Generation_CollectionCount
> kafka_GarbageCollector_G1_Old_Generation_CollectionTime
> kafka_GarbageCollector_G1_Young_Generation_CollectionCount
> kafka_GarbageCollector_G1_Young_Generation_CollectionTime
> kafka_Heartbeat_50thPercentile
> kafka_Heartbeat_95thPercentile
> kafka_Heartbeat_999thPercentile
> kafka_Heartbeat_99thPercentile
> kafka_Heartbeat_Count
> kafka_Heartbeat_Max
> kafka_Heartbeat_Mean
> kafka_Heartbeat_MeanRate
> kafka_Heartbeat_Min
> kafka_Heartbeat_OneMinuteRate
> kafka_Heartbeat_StdDev
> kafka_JoinGroup_50thPercentile
> kafka_JoinGroup_95thPercentile
> kafka_JoinGroup_999thPercentile
> kafka_JoinGroup_99thPercentile
> kafka_JoinGroup_Count
> kafka_JoinGroup_Max
> kafka_JoinGroup_Mean
> kafka_JoinGroup_MeanRate
> kafka_JoinGroup_Min
> kafka_JoinGroup_OneMinuteRate
> kafka_JoinGroup_StdDev
> kafka_KafkaRequestHandlerPool_RequestHandlerAvgIdlePercent_Count
> kafka_KafkaRequestHandlerPool_RequestHandlerAvgIdlePercent_MeanRate
> kafka_KafkaRequestHandlerPool_RequestHandlerAvgIdlePercent_OneMinuteRate
> kafka_LeaderAndIsr_50thPercentile
> kafka_LeaderAndIsr_95thPercentile
> kafka_LeaderAndIsr_999thPercentile
> kafka_LeaderAndIsr_99thPercentile
> kafka_LeaderAndIsr_Count
> kafka_LeaderAndIsr_Max
> kafka_LeaderAndIsr_Mean
> kafka_LeaderAndIsr_MeanRate
> kafka_LeaderAndIsr_Min
> kafka_LeaderAndIsr_OneMinuteRate
> kafka_LeaderAndIsr_StdDev
> kafka_LeaveGroup_50thPercentile
> kafka_LeaveGroup_95thPercentile
> kafka_LeaveGroup_999thPercentile
> kafka_LeaveGroup_99thPercentile
> kafka_LeaveGroup_Count
> kafka_LeaveGroup_Max
> kafka_LeaveGroup_Mean
> kafka_LeaveGroup_MeanRate
> kafka_LeaveGroup_Min
> kafka_LeaveGroup_OneMinuteRate
> kafka_LeaveGroup_StdDev
> kafka_ListGroups_50thPercentile
> kafka_ListGroups_95thPercentile
> kafka_ListGroups_999thPercentile
> kafka_ListGroups_99thPercentile
> kafka_ListGroups_Count
> kafka_ListGroups_Max
> kafka_ListGroups_Mean
> kafka_ListGroups_MeanRate
> kafka_ListGroups_Min
> kafka_ListGroups_OneMinuteRate
> kafka_ListGroups_StdDev
> kafka_ListOffsets_50thPercentile
> kafka_ListOffsets_95thPercentile
> kafka_ListOffsets_999thPercentile
> kafka_ListOffsets_99thPercentile
> kafka_ListOffsets_Count
> kafka_ListOffsets_Max
> kafka_ListOffsets_Mean
> kafka_ListOffsets_MeanRate
> kafka_ListOffsets_Min
> kafka_ListOffsets_OneMinuteRate
> kafka_ListOffsets_StdDev
> kafka_MessagesInPerSec_Count
> kafka_MessagesInPerSec_FifteenMinuteRate
> kafka_MessagesInPerSec_FiveMinuteRate
> kafka_MessagesInPerSec_MeanRate
> kafka_MessagesInPerSec_OneMinuteRate
> kafka_Metadata_50thPercentile
> kafka_Metadata_95thPercentile
> kafka_Metadata_999thPercentile
> kafka_Metadata_99thPercentile
> kafka_Metadata_Count
> kafka_Metadata_Max
> kafka_Metadata_Mean
> kafka_Metadata_MeanRate
> kafka_Metadata_Min
> kafka_Metadata_OneMinuteRate
> kafka_Metadata_StdDev
> kafka_OffsetCommit_50thPercentile
> kafka_OffsetCommit_95thPercentile
> kafka_OffsetCommit_999thPercentile
> kafka_OffsetCommit_99thPercentile
> kafka_OffsetCommit_Count
> kafka_OffsetCommit_Max
> kafka_OffsetCommit_Mean
> kafka_OffsetCommit_MeanRate
> kafka_OffsetCommit_Min
> kafka_OffsetCommit_OneMinuteRate
> kafka_OffsetCommit_StdDev
> kafka_OffsetFetch_50thPercentile
> kafka_OffsetFetch_95thPercentile
> kafka_OffsetFetch_999thPercentile
> kafka_OffsetFetch_99thPercentile
> kafka_OffsetFetch_Count
> kafka_OffsetFetch_Max
> kafka_OffsetFetch_Mean
> kafka_OffsetFetch_MeanRate
> kafka_OffsetFetch_Min
> kafka_OffsetFetch_OneMinuteRate
> kafka_OffsetFetch_StdDev
> kafka_ProduceMessageConversionsPerSec_Count
> kafka_ProduceMessageConversionsPerSec_FifteenMinuteRate
> kafka_ProduceMessageConversionsPerSec_FiveMinuteRate
> kafka_ProduceMessageConversionsPerSec_MeanRate
> kafka_ProduceMessageConversionsPerSec_OneMinuteRate
> kafka_Produce_50thPercentile
> kafka_Produce_95thPercentile
> kafka_Produce_999thPercentile
> kafka_Produce_99thPercentile
> kafka_Produce_Count
> kafka_Produce_Max
> kafka_Produce_Mean
> kafka_Produce_MeanRate
> kafka_Produce_Min
> kafka_Produce_OneMinuteRate
> kafka_Produce_StdDev
> kafka_ReplicationBytesInPerSec_Count
> kafka_ReplicationBytesInPerSec_FifteenMinuteRate
> kafka_ReplicationBytesInPerSec_FiveMinuteRate
> kafka_ReplicationBytesInPerSec_MeanRate
> kafka_ReplicationBytesInPerSec_OneMinuteRate
> kafka_ReplicationBytesOutPerSec_Count
> kafka_ReplicationBytesOutPerSec_FifteenMinuteRate
> kafka_ReplicationBytesOutPerSec_FiveMinuteRate
> kafka_ReplicationBytesOutPerSec_MeanRate
> kafka_ReplicationBytesOutPerSec_OneMinuteRate
> kafka_RequestChannel_RequestQueueSize_Value
> kafka_RequestChannel_ResponseQueueSize_Value
> kafka_RequestMetrics_RequestsPerSec_Count
> kafka_RequestMetrics_RequestsPerSec_MeanRate
> kafka_RequestMetrics_RequestsPerSec_OneMinuteRate
> kafka_SocketServer_MemoryPoolAvailable_Value
> kafka_SocketServer_MemoryPoolUsed_Value
> kafka_SocketServer_NetworkProcessorAvgIdlePercent_Value
> kafka_SyncGroup_50thPercentile
> kafka_SyncGroup_95thPercentile
> kafka_SyncGroup_999thPercentile
> kafka_SyncGroup_99thPercentile
> kafka_SyncGroup_Count
> kafka_SyncGroup_Max
> kafka_SyncGroup_Mean
> kafka_SyncGroup_MeanRate
> kafka_SyncGroup_Min
> kafka_SyncGroup_OneMinuteRate
> kafka_SyncGroup_StdDev
> kafka_ThreadCount
> kafka_Threading_CurrentThreadCpuTime
> kafka_Threading_CurrentThreadUserTime
> kafka_Threading_DaemonThreadCount
> kafka_Threading_PeakThreadCount
> kafka_Threading_ThreadCount
> kafka_Threading_TotalStartedThreadCount
> kafka_TotalFetchRequestsPerSec_Count
> kafka_TotalFetchRequestsPerSec_FifteenMinuteRate
> kafka_TotalFetchRequestsPerSec_FiveMinuteRate
> kafka_TotalFetchRequestsPerSec_MeanRate
> kafka_TotalFetchRequestsPerSec_OneMinuteRate
> kafka_TotalProduceRequestsPerSec_Count
> kafka_TotalProduceRequestsPerSec_FifteenMinuteRate
> kafka_TotalProduceRequestsPerSec_FiveMinuteRate
> kafka_TotalProduceRequestsPerSec_MeanRate
> kafka_TotalProduceRequestsPerSec_OneMinuteRate
> kafka_UpdateMetadata_50thPercentile
> kafka_UpdateMetadata_95thPercentile
> kafka_UpdateMetadata_999thPercentile
> kafka_UpdateMetadata_99thPercentile
> kafka_UpdateMetadata_Count
> kafka_UpdateMetadata_Max
> kafka_UpdateMetadata_Mean
> kafka_UpdateMetadata_MeanRate
> kafka_UpdateMetadata_Min
> kafka_UpdateMetadata_OneMinuteRate
> kafka_UpdateMetadata_StdDev
> kafka_consumer_lag



--
This message was sent by Atlassian Jira
(v8.3.4#803005)