[jira] [Updated] (KAFKA-8995) Add new metric on broker to illustrate produce request compression percentage

["Guozhang Wang (Jira)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/KAFKA-8995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Guozhang Wang updated KAFKA-8995:
---------------------------------
    Reporter: Jun Rao  (was: Guozhang Wang)

> Add new metric on broker to illustrate produce request compression percentage
> -----------------------------------------------------------------------------
>
>                 Key: KAFKA-8995
>                 URL: https://issues.apache.org/jira/browse/KAFKA-8995
>             Project: Kafka
>          Issue Type: Improvement
>          Components: core
>            Reporter: Jun Rao
>            Assignee: Guozhang Wang
>            Priority: Major
>              Labels: needs-kip
>
> When `compression.type` is set to `producer`, we would accept produce request and use its encoded compression to apply to the logs; otherwise we would recompress the message according to the configured compression type before appending. There are pros and cons to recompress the data: you pay more CPU to recompress, but you reduce the storage cost. 
> In practice, if the incoming produce requests are not compressed, then compressing before appending maybe more beneficial, otherwise just keep them as if `producer` config maybe better. Adding a metric to expose the incoming requests' compression in percentage would be a helpful data point to help operators selecting their compression policy.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)