You are viewing a plain text version of this content. The canonical link for it is here.

Posted to jira@kafka.apache.org by "NIKHIL (Jira)" <ji...@apache.org> on 2019/08/26 15:21:00 UTC

[jira] [Updated] (KAFKA-8833) Metric for Broker Consumer Lag in size and time

     [ https://issues.apache.org/jira/browse/KAFKA-8833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

NIKHIL updated KAFKA-8833:
--------------------------
    Description: 
In many use cases consumers are expected to fetch at the tail end of the log. The proposal is to have stats on consumer lag in terms for bytes as well as time. We will add broker level metrics aggregated across all partitions. Both metrics will be histogram.
  
 - FetchLagTimeInMs: Histogram that will measure fetch log lag using the timestamp of the messages being fetched  
 - FetchLagBytes: Histogram that will measure the fetch log lag by calculating the byte lag of the message being fetched
  

  was:
In many use cases consumers are expected to fetch at the tail end of the log. The proposal is to have stats on consumer lag in terms for bytes as well as time. We will add broker level metrics aggregated across all partitions. Both metrics will be histogram.
 
- FetchLagTimeInMs: Histogram that will measure fetch log lag using the timestamp of the messages being fetched  
- FetchLagBytes: Histogram that will measure the fetch log lag by calculating the byte lag of the message being fetched
 


> Metric for Broker Consumer Lag in size and time
> -----------------------------------------------
>
>                 Key: KAFKA-8833
>                 URL: https://issues.apache.org/jira/browse/KAFKA-8833
>             Project: Kafka
>          Issue Type: Improvement
>          Components: metrics
>            Reporter: NIKHIL
>            Priority: Major
>
> In many use cases consumers are expected to fetch at the tail end of the log. The proposal is to have stats on consumer lag in terms for bytes as well as time. We will add broker level metrics aggregated across all partitions. Both metrics will be histogram.
>   
>  - FetchLagTimeInMs: Histogram that will measure fetch log lag using the timestamp of the messages being fetched  
>  - FetchLagBytes: Histogram that will measure the fetch log lag by calculating the byte lag of the message being fetched
>   



--
This message was sent by Atlassian Jira
(v8.3.2#803003)