[jira] [Created] (FLINK-32643) Introduce off-heap shared state cache across stateful operators in TM

["Fang Yong (Jira)" <ji...@apache.org>]

Fang Yong created FLINK-32643:
---------------------------------

             Summary: Introduce off-heap shared state cache across stateful operators in TM
                 Key: FLINK-32643
                 URL: https://issues.apache.org/jira/browse/FLINK-32643
             Project: Flink
          Issue Type: Improvement
          Components: Runtime / State Backends
    Affects Versions: 1.19.0
            Reporter: Fang Yong


Currently each stateful operator will create an independent db instance if it uses rocksdb as state backend, and we can configure `state.backend.rocksdb.block.cache-size` for each db to speed up state performance. This parameter defaults to 8M, and we cannot set it too large, such as 512M, this may cause OOM and each DB cannot effectively utilize memory. To address this issue, we would like to introduce off-heap shared state cache across multiple db instances for stateful operators in TM.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)