You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@flink.apache.org by "Jufang He (Jira)" <ji...@apache.org> on 2024/03/01 08:11:00 UTC

[jira] [Created] (FLINK-34558) Add RocksDB key/value size metrics

Jufang He created FLINK-34558:
---------------------------------

             Summary: Add RocksDB key/value size metrics
                 Key: FLINK-34558
                 URL: https://issues.apache.org/jira/browse/FLINK-34558
             Project: Flink
          Issue Type: Improvement
          Components: Runtime / State Backends
    Affects Versions: 1.19.0
            Reporter: Jufang He


In some scenarios, the poor performance of RocksDB may be caused by too large key/value size, but now there is a lack of metrics for key/value size. By adding these metrics, we can conveniently calculate the distribution of key/value size, such as the average size and p99 size.  To reduce the negative impact of adding metric on RocksDB performance, we could reduce the impact by supporting sampling.

The possible implementation is as follows: After the RocksDB key/value serialization, we could obtain the byte array and report the size of the array through histogram metrics.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)