You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@flink.apache.org by "Yingjie Cao (Jira)" <ji...@apache.org> on 2022/07/04 12:51:00 UTC

[jira] [Created] (FLINK-28382) Introduce new compression algorithms of higher compression ratio

Yingjie Cao created FLINK-28382:
-----------------------------------

             Summary: Introduce new compression algorithms of higher compression ratio
                 Key: FLINK-28382
                 URL: https://issues.apache.org/jira/browse/FLINK-28382
             Project: Flink
          Issue Type: Bug
          Components: Runtime / Network
            Reporter: Yingjie Cao
             Fix For: 1.16.0


Currently, we use lz4 for shuffle data compression which is a good balance between IO optimization and CPU consumption. But for some scenarios, the IO becomes bottleneck and the storage space is limited (especially for k8s environment). For these cases, we need compression algorithms of higher compression ratio to further reduce IO.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)