You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@nifi.apache.org by "David Handermann (Jira)" <ji...@apache.org> on 2026/09/21 14:59:00 UTC

[jira] [Created] (NIFI-16375) Add Lag and Records Metrics to ConsumeKafka

David Handermann created NIFI-16375:
---------------------------------------

             Summary: Add Lag and Records Metrics to ConsumeKafka
                 Key: NIFI-16375
                 URL: https://issues.apache.org/jira/browse/NIFI-16375
             Project: Apache NiFi
          Issue Type: Improvement
          Components: Extensions
            Reporter: David Handermann
            Assignee: David Handermann


The {{ConsumeKafka}} Processor should be updated to record the following lag and record metrics for each invocation, supporting topic and partition-level tracking using the recently-attributes Map of attributes for Counters and Gauges.
 * kafka.bytes.consumed
 ** Type: Counter
 * kafka.records.consumed
 ** Type: Counter
 * kafka.records.consumer.log
 ** Type: Gauge
 * kafka.records.parsed.errors
 ** Type: Counter

Although the Kafka MetricsReporter provides some capabilities, it does not support all of these types of instrumentation details, so implementing the Counters and Gauges using ProcessSession methods appears to be the best approach.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)