[jira] [Commented] (CASSANDRA-20488) Add ZSTD support for over-the-wire compression

["Michael Karsten (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/CASSANDRA-20488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17941933#comment-17941933 ] 

Michael Karsten commented on CASSANDRA-20488:
---------------------------------------------

(y). I've seen >30% reduction in disk space with time series data by switching from LZ4 to Zstd with negligible latency impact. It could be advantageous from a cloud cost standpoint to also use Zstd over-the-wire.

> Add ZSTD support for over-the-wire compression
> ----------------------------------------------
>
>                 Key: CASSANDRA-20488
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-20488
>             Project: Apache Cassandra
>          Issue Type: New Feature
>          Components: Messaging/Internode
>            Reporter: Thomas Steinmaurer
>            Assignee: Stefan Miklosovic
>            Priority: Normal
>
> Could we please consider to offer ZSTD as additional (beside LZ4) compressor for over-the-wire compression, if it was not intentional to not supporting ZSTD in messaging, beside ZSTD being supported for SSTable on-disk compression.
> We still could keep LZ4 as default of course when network compression is enabled in cassandra.yaml, but for users who want to optimize primary towards network traffic, this could be quite beneficial from a cost perspective when thinking about cloud provider (AWS) cross availability zone network traffic costs as the result of data replication in a setup of replication factor = number of racks (AVZs), as ZSTD is used to provide a better compression ratio compared to LZ4 at an acceptable throughput (at least in the SSTable department).
> Configuration-wise this could be an additional parameter in cassandra.yaml with LZ4 as default.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@cassandra.apache.org
For additional commands, e-mail: commits-help@cassandra.apache.org