[jira] [Created] (KAFKA-8995) Add new metric on broker to illustrate produce request compression percentage

["Guozhang Wang (Jira)" <ji...@apache.org>]

Guozhang Wang created KAFKA-8995:
------------------------------------

             Summary: Add new metric on broker to illustrate produce request compression percentage
                 Key: KAFKA-8995
                 URL: https://issues.apache.org/jira/browse/KAFKA-8995
             Project: Kafka
          Issue Type: Improvement
          Components: core
            Reporter: Guozhang Wang
            Assignee: Guozhang Wang


When `compression.type` is set to `producer`, we would accept produce request and use its encoded compression to apply to the logs; otherwise we would recompress the message according to the configured compression type before appending. There are pros and cons to recompress the data: you pay more CPU to recompress, but you reduce the storage cost. 

In practice, if the incoming produce requests are not compressed, then compressing before appending maybe more beneficial, otherwise just keep them as if `producer` config maybe better. Adding a metric to expose the incoming requests' compression in percentage would be a helpful data point to help operators selecting their compression policy.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)