KIP-575: build a Kafka-Exporter by Java

[萨尔卡 <10...@qq.com>]

hi all,
KIP-575
kafka is an excellent MQ running on JVM,  but no exporters JVMly. for a better future of  Kafka-Ecosystems
the Apache needs a formal exporter like https://github.com/apache/kafka-exporter. 
i wrote one for working, and hope to give to Apache. there are a lot of metric in JMX, it can be configed in the exporter-config.


if you are interested in it , join me!
if you are interested in it , join me!

if you are interested in it , join me!



for some metric list here:
kafka_AddPartitionsToTxn_50thPercentile
kafka_AddPartitionsToTxn_95thPercentile
kafka_AddPartitionsToTxn_999thPercentile
kafka_AddPartitionsToTxn_99thPercentile
kafka_AddPartitionsToTxn_Count
kafka_AddPartitionsToTxn_Max
kafka_AddPartitionsToTxn_Mean
kafka_AddPartitionsToTxn_MeanRate
kafka_AddPartitionsToTxn_Min
kafka_AddPartitionsToTxn_OneMinuteRate
kafka_AddPartitionsToTxn_StdDev
kafka_BrokerTopicMetrics_BytesInPerSec_Count
kafka_BrokerTopicMetrics_BytesInPerSec_MeanRate
kafka_BrokerTopicMetrics_BytesInPerSec_OneMinuteRate
kafka_BrokerTopicMetrics_BytesOutPerSec_Count
kafka_BrokerTopicMetrics_BytesOutPerSec_MeanRate
kafka_BrokerTopicMetrics_BytesOutPerSec_OneMinuteRate
kafka_BrokerTopicMetrics_BytesRejectedPerSec_Count
kafka_BrokerTopicMetrics_BytesRejectedPerSec_MeanRate
kafka_BrokerTopicMetrics_BytesRejectedPerSec_OneMinuteRate
kafka_BrokerTopicMetrics_FailedFetchRequestsPerSec_Count
kafka_BrokerTopicMetrics_FailedFetchRequestsPerSec_MeanRate
kafka_BrokerTopicMetrics_FailedFetchRequestsPerSec_OneMinuteRate
kafka_BrokerTopicMetrics_FailedProduceRequestsPerSec_Count
kafka_BrokerTopicMetrics_FailedProduceRequestsPerSec_MeanRate
kafka_BrokerTopicMetrics_FailedProduceRequestsPerSec_OneMinuteRate
kafka_BrokerTopicMetrics_MessagesInPerSec_Count
kafka_BrokerTopicMetrics_MessagesInPerSec_MeanRate
kafka_BrokerTopicMetrics_MessagesInPerSec_OneMinuteRate
kafka_BrokerTopicMetrics_ProduceMessageConversionsPerSec_Count
kafka_BrokerTopicMetrics_ProduceMessageConversionsPerSec_MeanRate
kafka_BrokerTopicMetrics_ProduceMessageConversionsPerSec_OneMinuteRate
kafka_BrokerTopicMetrics_ReplicationBytesInPerSec_Count
kafka_BrokerTopicMetrics_ReplicationBytesInPerSec_MeanRate
kafka_BrokerTopicMetrics_ReplicationBytesInPerSec_OneMinuteRate
kafka_BrokerTopicMetrics_ReplicationBytesOutPerSec_Count
kafka_BrokerTopicMetrics_ReplicationBytesOutPerSec_MeanRate
kafka_BrokerTopicMetrics_ReplicationBytesOutPerSec_OneMinuteRate
kafka_BrokerTopicMetrics_TotalFetchRequestsPerSec_Count
kafka_BrokerTopicMetrics_TotalFetchRequestsPerSec_MeanRate
kafka_BrokerTopicMetrics_TotalFetchRequestsPerSec_OneMinuteRate
kafka_BrokerTopicMetrics_TotalProduceRequestsPerSec_Count
kafka_BrokerTopicMetrics_TotalProduceRequestsPerSec_MeanRate
kafka_BrokerTopicMetrics_TotalProduceRequestsPerSec_OneMinuteRate
kafka_BytesInPerSec_Count
kafka_BytesInPerSec_FifteenMinuteRate
kafka_BytesInPerSec_FiveMinuteRate
kafka_BytesInPerSec_MeanRate
kafka_BytesInPerSec_OneMinuteRate
kafka_BytesOutPerSec_Count
kafka_BytesOutPerSec_FifteenMinuteRate
kafka_BytesOutPerSec_FiveMinuteRate
kafka_BytesOutPerSec_MeanRate
kafka_BytesOutPerSec_OneMinuteRate
kafka_BytesRejectedPerSec_Count
kafka_BytesRejectedPerSec_FifteenMinuteRate
kafka_BytesRejectedPerSec_FiveMinuteRate
kafka_BytesRejectedPerSec_MeanRate
kafka_BytesRejectedPerSec_OneMinuteRate
kafka_CreatePartitions_50thPercentile
kafka_CreatePartitions_95thPercentile
kafka_CreatePartitions_999thPercentile
kafka_CreatePartitions_99thPercentile
kafka_CreatePartitions_Count
kafka_CreatePartitions_Max
kafka_CreatePartitions_Mean
kafka_CreatePartitions_MeanRate
kafka_CreatePartitions_Min
kafka_CreatePartitions_OneMinuteRate
kafka_CreatePartitions_StdDev
kafka_CreateTopics_50thPercentile
kafka_CreateTopics_95thPercentile
kafka_CreateTopics_999thPercentile
kafka_CreateTopics_99thPercentile
kafka_CreateTopics_Count
kafka_CreateTopics_Max
kafka_CreateTopics_Mean
kafka_CreateTopics_MeanRate
kafka_CreateTopics_Min
kafka_CreateTopics_OneMinuteRate
kafka_CreateTopics_StdDev
kafka_DeleteGroups_50thPercentile
kafka_DeleteGroups_95thPercentile
kafka_DeleteGroups_999thPercentile
kafka_DeleteGroups_99thPercentile
kafka_DeleteGroups_Count
kafka_DeleteGroups_Max
kafka_DeleteGroups_Mean
kafka_DeleteGroups_Min
kafka_DeleteGroups_StdDev
kafka_DeleteTopics_50thPercentile
kafka_DeleteTopics_95thPercentile
kafka_DeleteTopics_999thPercentile
kafka_DeleteTopics_99thPercentile
kafka_DeleteTopics_Count
kafka_DeleteTopics_Max
kafka_DeleteTopics_Mean
kafka_DeleteTopics_MeanRate
kafka_DeleteTopics_Min
kafka_DeleteTopics_OneMinuteRate
kafka_DeleteTopics_StdDev
kafka_DescribeGroups_50thPercentile
kafka_DescribeGroups_95thPercentile
kafka_DescribeGroups_999thPercentile
kafka_DescribeGroups_99thPercentile
kafka_DescribeGroups_Count
kafka_DescribeGroups_Max
kafka_DescribeGroups_Mean
kafka_DescribeGroups_MeanRate
kafka_DescribeGroups_Min
kafka_DescribeGroups_OneMinuteRate
kafka_DescribeGroups_StdDev
kafka_FailedFetchRequestsPerSec_Count
kafka_FailedFetchRequestsPerSec_FifteenMinuteRate
kafka_FailedFetchRequestsPerSec_FiveMinuteRate
kafka_FailedFetchRequestsPerSec_MeanRate
kafka_FailedFetchRequestsPerSec_OneMinuteRate
kafka_FailedProduceRequestsPerSec_Count
kafka_FailedProduceRequestsPerSec_FifteenMinuteRate
kafka_FailedProduceRequestsPerSec_FiveMinuteRate
kafka_FailedProduceRequestsPerSec_MeanRate
kafka_FailedProduceRequestsPerSec_OneMinuteRate
kafka_FetchConsumer_50thPercentile
kafka_FetchConsumer_95thPercentile
kafka_FetchConsumer_999thPercentile
kafka_FetchConsumer_99thPercentile
kafka_FetchConsumer_Count
kafka_FetchConsumer_Max
kafka_FetchConsumer_Mean
kafka_FetchConsumer_MeanRate
kafka_FetchConsumer_Min
kafka_FetchConsumer_OneMinuteRate
kafka_FetchConsumer_StdDev
kafka_FetchFollower_50thPercentile
kafka_FetchFollower_95thPercentile
kafka_FetchFollower_999thPercentile
kafka_FetchFollower_99thPercentile
kafka_FetchFollower_Count
kafka_FetchFollower_Max
kafka_FetchFollower_Mean
kafka_FetchFollower_MeanRate
kafka_FetchFollower_Min
kafka_FetchFollower_OneMinuteRate
kafka_FetchFollower_StdDev
kafka_FetchMessageConversionsPerSec_Count
kafka_FetchMessageConversionsPerSec_FifteenMinuteRate
kafka_FetchMessageConversionsPerSec_FiveMinuteRate
kafka_FetchMessageConversionsPerSec_MeanRate
kafka_FetchMessageConversionsPerSec_OneMinuteRate
kafka_Fetch_50thPercentile
kafka_Fetch_95thPercentile
kafka_Fetch_999thPercentile
kafka_Fetch_99thPercentile
kafka_Fetch_Count
kafka_Fetch_Max
kafka_Fetch_Mean
kafka_Fetch_MeanRate
kafka_Fetch_Min
kafka_Fetch_OneMinuteRate
kafka_Fetch_StdDev
kafka_FindCoordinator_50thPercentile
kafka_FindCoordinator_95thPercentile
kafka_FindCoordinator_999thPercentile
kafka_FindCoordinator_99thPercentile
kafka_FindCoordinator_Count
kafka_FindCoordinator_Max
kafka_FindCoordinator_Mean
kafka_FindCoordinator_MeanRate
kafka_FindCoordinator_Min
kafka_FindCoordinator_OneMinuteRate
kafka_FindCoordinator_StdDev
kafka_G1_Old_Generation_CollectionCount
kafka_G1_Old_Generation_CollectionTime
kafka_G1_Young_Generation_CollectionCount
kafka_G1_Young_Generation_CollectionTime
kafka_GarbageCollector_G1_Old_Generation_CollectionCount
kafka_GarbageCollector_G1_Old_Generation_CollectionTime
kafka_GarbageCollector_G1_Young_Generation_CollectionCount
kafka_GarbageCollector_G1_Young_Generation_CollectionTime
kafka_Heartbeat_50thPercentile
kafka_Heartbeat_95thPercentile
kafka_Heartbeat_999thPercentile
kafka_Heartbeat_99thPercentile
kafka_Heartbeat_Count
kafka_Heartbeat_Max
kafka_Heartbeat_Mean
kafka_Heartbeat_MeanRate
kafka_Heartbeat_Min
kafka_Heartbeat_OneMinuteRate
kafka_Heartbeat_StdDev
kafka_JoinGroup_50thPercentile
kafka_JoinGroup_95thPercentile
kafka_JoinGroup_999thPercentile
kafka_JoinGroup_99thPercentile
kafka_JoinGroup_Count
kafka_JoinGroup_Max
kafka_JoinGroup_Mean
kafka_JoinGroup_MeanRate
kafka_JoinGroup_Min
kafka_JoinGroup_OneMinuteRate
kafka_JoinGroup_StdDev
kafka_KafkaRequestHandlerPool_RequestHandlerAvgIdlePercent_Count
kafka_KafkaRequestHandlerPool_RequestHandlerAvgIdlePercent_MeanRate
kafka_KafkaRequestHandlerPool_RequestHandlerAvgIdlePercent_OneMinuteRate
kafka_LeaderAndIsr_50thPercentile
kafka_LeaderAndIsr_95thPercentile
kafka_LeaderAndIsr_999thPercentile
kafka_LeaderAndIsr_99thPercentile
kafka_LeaderAndIsr_Count
kafka_LeaderAndIsr_Max
kafka_LeaderAndIsr_Mean
kafka_LeaderAndIsr_MeanRate
kafka_LeaderAndIsr_Min
kafka_LeaderAndIsr_OneMinuteRate
kafka_LeaderAndIsr_StdDev
kafka_LeaveGroup_50thPercentile
kafka_LeaveGroup_95thPercentile
kafka_LeaveGroup_999thPercentile
kafka_LeaveGroup_99thPercentile
kafka_LeaveGroup_Count
kafka_LeaveGroup_Max
kafka_LeaveGroup_Mean
kafka_LeaveGroup_MeanRate
kafka_LeaveGroup_Min
kafka_LeaveGroup_OneMinuteRate
kafka_LeaveGroup_StdDev
kafka_ListGroups_50thPercentile
kafka_ListGroups_95thPercentile
kafka_ListGroups_999thPercentile
kafka_ListGroups_99thPercentile
kafka_ListGroups_Count
kafka_ListGroups_Max
kafka_ListGroups_Mean
kafka_ListGroups_MeanRate
kafka_ListGroups_Min
kafka_ListGroups_OneMinuteRate
kafka_ListGroups_StdDev
kafka_ListOffsets_50thPercentile
kafka_ListOffsets_95thPercentile
kafka_ListOffsets_999thPercentile
kafka_ListOffsets_99thPercentile
kafka_ListOffsets_Count
kafka_ListOffsets_Max
kafka_ListOffsets_Mean
kafka_ListOffsets_MeanRate
kafka_ListOffsets_Min
kafka_ListOffsets_OneMinuteRate
kafka_ListOffsets_StdDev
kafka_MessagesInPerSec_Count
kafka_MessagesInPerSec_FifteenMinuteRate
kafka_MessagesInPerSec_FiveMinuteRate
kafka_MessagesInPerSec_MeanRate
kafka_MessagesInPerSec_OneMinuteRate
kafka_Metadata_50thPercentile
kafka_Metadata_95thPercentile
kafka_Metadata_999thPercentile
kafka_Metadata_99thPercentile
kafka_Metadata_Count
kafka_Metadata_Max
kafka_Metadata_Mean
kafka_Metadata_MeanRate
kafka_Metadata_Min
kafka_Metadata_OneMinuteRate
kafka_Metadata_StdDev
kafka_OffsetCommit_50thPercentile
kafka_OffsetCommit_95thPercentile
kafka_OffsetCommit_999thPercentile
kafka_OffsetCommit_99thPercentile
kafka_OffsetCommit_Count
kafka_OffsetCommit_Max
kafka_OffsetCommit_Mean
kafka_OffsetCommit_MeanRate
kafka_OffsetCommit_Min
kafka_OffsetCommit_OneMinuteRate
kafka_OffsetCommit_StdDev
kafka_OffsetFetch_50thPercentile
kafka_OffsetFetch_95thPercentile
kafka_OffsetFetch_999thPercentile
kafka_OffsetFetch_99thPercentile
kafka_OffsetFetch_Count
kafka_OffsetFetch_Max
kafka_OffsetFetch_Mean
kafka_OffsetFetch_MeanRate
kafka_OffsetFetch_Min
kafka_OffsetFetch_OneMinuteRate
kafka_OffsetFetch_StdDev
kafka_ProduceMessageConversionsPerSec_Count
kafka_ProduceMessageConversionsPerSec_FifteenMinuteRate
kafka_ProduceMessageConversionsPerSec_FiveMinuteRate
kafka_ProduceMessageConversionsPerSec_MeanRate
kafka_ProduceMessageConversionsPerSec_OneMinuteRate
kafka_Produce_50thPercentile
kafka_Produce_95thPercentile
kafka_Produce_999thPercentile
kafka_Produce_99thPercentile
kafka_Produce_Count
kafka_Produce_Max
kafka_Produce_Mean
kafka_Produce_MeanRate
kafka_Produce_Min
kafka_Produce_OneMinuteRate
kafka_Produce_StdDev
kafka_ReplicationBytesInPerSec_Count
kafka_ReplicationBytesInPerSec_FifteenMinuteRate
kafka_ReplicationBytesInPerSec_FiveMinuteRate
kafka_ReplicationBytesInPerSec_MeanRate
kafka_ReplicationBytesInPerSec_OneMinuteRate
kafka_ReplicationBytesOutPerSec_Count
kafka_ReplicationBytesOutPerSec_FifteenMinuteRate
kafka_ReplicationBytesOutPerSec_FiveMinuteRate
kafka_ReplicationBytesOutPerSec_MeanRate
kafka_ReplicationBytesOutPerSec_OneMinuteRate
kafka_RequestChannel_RequestQueueSize_Value
kafka_RequestChannel_ResponseQueueSize_Value
kafka_RequestMetrics_RequestsPerSec_Count
kafka_RequestMetrics_RequestsPerSec_MeanRate
kafka_RequestMetrics_RequestsPerSec_OneMinuteRate
kafka_SocketServer_MemoryPoolAvailable_Value
kafka_SocketServer_MemoryPoolUsed_Value
kafka_SocketServer_NetworkProcessorAvgIdlePercent_Value
kafka_SyncGroup_50thPercentile
kafka_SyncGroup_95thPercentile
kafka_SyncGroup_999thPercentile
kafka_SyncGroup_99thPercentile
kafka_SyncGroup_Count
kafka_SyncGroup_Max
kafka_SyncGroup_Mean
kafka_SyncGroup_MeanRate
kafka_SyncGroup_Min
kafka_SyncGroup_OneMinuteRate
kafka_SyncGroup_StdDev
kafka_ThreadCount
kafka_Threading_CurrentThreadCpuTime
kafka_Threading_CurrentThreadUserTime
kafka_Threading_DaemonThreadCount
kafka_Threading_PeakThreadCount
kafka_Threading_ThreadCount
kafka_Threading_TotalStartedThreadCount
kafka_TotalFetchRequestsPerSec_Count
kafka_TotalFetchRequestsPerSec_FifteenMinuteRate
kafka_TotalFetchRequestsPerSec_FiveMinuteRate
kafka_TotalFetchRequestsPerSec_MeanRate
kafka_TotalFetchRequestsPerSec_OneMinuteRate
kafka_TotalProduceRequestsPerSec_Count
kafka_TotalProduceRequestsPerSec_FifteenMinuteRate
kafka_TotalProduceRequestsPerSec_FiveMinuteRate
kafka_TotalProduceRequestsPerSec_MeanRate
kafka_TotalProduceRequestsPerSec_OneMinuteRate
kafka_UpdateMetadata_50thPercentile
kafka_UpdateMetadata_95thPercentile
kafka_UpdateMetadata_999thPercentile
kafka_UpdateMetadata_99thPercentile
kafka_UpdateMetadata_Count
kafka_UpdateMetadata_Max
kafka_UpdateMetadata_Mean
kafka_UpdateMetadata_MeanRate
kafka_UpdateMetadata_Min
kafka_UpdateMetadata_OneMinuteRate
kafka_UpdateMetadata_StdDev
kafka_consumer_lag




Have a nice dayFrancis Lee


QQ : 1026203200