[jira] [Commented] (KAFKA-8833) Metric for Broker Consumer Lag in size and time

["ASF GitHub Bot (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/KAFKA-8833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16957562#comment-16957562 ] 

ASF GitHub Bot commented on KAFKA-8833:
---------------------------------------

rite2nikhil commented on pull request #7273: KAFKA-8833/KIP-514 - Broker Consumer Lag metrics in size and time
URL: https://github.com/apache/kafka/pull/7273
 
 
   
 
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


> Metric for Broker Consumer Lag in size and time
> -----------------------------------------------
>
>                 Key: KAFKA-8833
>                 URL: https://issues.apache.org/jira/browse/KAFKA-8833
>             Project: Kafka
>          Issue Type: Improvement
>          Components: metrics
>            Reporter: NIKHIL
>            Priority: Major
>
> In many use cases consumers are expected to fetch at the tail end of the log. The proposal is to have stats on consumer lag in terms for bytes as well as time. We will add broker level metrics aggregated across all partitions. Both metrics will be histogram.
>   
>  - FetchLagTimeInMs: Histogram that will measure fetch log lag using the timestamp of the messages being fetched  
>  - FetchLagBytes: Histogram that will measure the fetch log lag by calculating the byte lag of the message being fetched
>   



--
This message was sent by Atlassian Jira
(v8.3.4#803005)