You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@flink.apache.org by "Yue Ma (Jira)" <ji...@apache.org> on 2023/12/14 03:36:00 UTC

[jira] [Updated] (FLINK-33819) Suppor setting CompressType in RocksDBStateBackend

     [ https://issues.apache.org/jira/browse/FLINK-33819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Yue Ma updated FLINK-33819:
---------------------------
    Description: 
Currently, RocksDBStateBackend does not support setting the compression level, and Snappy is used for compression by default. But we have some scenarios where compression will use a lot of CPU resources. Turning off compression can significantly reduce CPU overhead. So we may need to support a parameter for users to set the CompressType of Rocksdb.

  !image-2023-12-14-11-35-22-306.png!

  was:
Currently, RocksDBStateBackend does not support setting the compression level, and Snappy is used for compression by default. But we have some scenarios where compression will use a lot of CPU resources. Turning off compression can significantly reduce CPU overhead. So we may need to support a parameter for users to set the CompressType of Rocksdb.

  !https://internal-api-drive-stream.larkoffice.com/space/api/box/stream/download/preview/ALADbWTMGoD6WexSFGecz2Olnrb/?preview_type=16!


> Suppor setting CompressType in RocksDBStateBackend
> --------------------------------------------------
>
>                 Key: FLINK-33819
>                 URL: https://issues.apache.org/jira/browse/FLINK-33819
>             Project: Flink
>          Issue Type: Improvement
>          Components: Runtime / State Backends
>    Affects Versions: 1.18.0
>            Reporter: Yue Ma
>            Priority: Major
>             Fix For: 1.19.0
>
>         Attachments: image-2023-12-14-11-32-32-968.png, image-2023-12-14-11-35-22-306.png
>
>
> Currently, RocksDBStateBackend does not support setting the compression level, and Snappy is used for compression by default. But we have some scenarios where compression will use a lot of CPU resources. Turning off compression can significantly reduce CPU overhead. So we may need to support a parameter for users to set the CompressType of Rocksdb.
>   !image-2023-12-14-11-35-22-306.png!



--
This message was sent by Atlassian Jira
(v8.20.10#820010)