You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@kafka.apache.org by "Ivan Babrou (JIRA)" <ji...@apache.org> on 2018/01/22 01:55:00 UTC

[jira] [Created] (KAFKA-6465) Add a metrics for the number of records per log

Ivan Babrou created KAFKA-6465:
----------------------------------

             Summary: Add a metrics for the number of records per log
                 Key: KAFKA-6465
                 URL: https://issues.apache.org/jira/browse/KAFKA-6465
             Project: Kafka
          Issue Type: Bug
            Reporter: Ivan Babrou


Currently there are log metrics for:
 * Start offset
 * End offset
 * Size in bytes
 * Number of segments

I propose to add another metric to track number of record batches in the log. This should provide operators with an idea of how much batching is happening on the producers. Having this metric in one place seems easier than scraping the metric from each producer.

Having an absolute counter may be infeasible (batches are not assigned sequential IDs), but gauge should be ok. Average batch size can be calculated as (end offset - start offset) / number of batches. This will be heavily skewed for logs with long retention, though.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)