You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@kafka.apache.org by "Dongjin Lee (Jira)" <ji...@apache.org> on 2021/10/10 12:16:00 UTC
[jira] [Created] (KAFKA-13361) Support fine-grained compression
options
Dongjin Lee created KAFKA-13361:
-----------------------------------
Summary: Support fine-grained compression options
Key: KAFKA-13361
URL: https://issues.apache.org/jira/browse/KAFKA-13361
Project: Kafka
Issue Type: Improvement
Components: clients, core
Reporter: Dongjin Lee
Assignee: Dongjin Lee
Adds the following options into the Producer, Broker, and Topic configurations:
* compression.gzip.buffer: the buffer size that feeds raw input into the Deflator or is fed by the uncompressed output from the Deflator. (available: [512, ), default: 8192(=8kb).)
* compression.snappy.block: the block size that snappy uses. (available: [1024, ), default: 32768(=32kb).)
* compression.lz4.block: the block size that lz4 uses. (available: [4, 7], (means 64kb, 256kb, 1mb, 4mb respectively), default: 4.)
* compression.zstd.window: enables long mode; the log of the window size that zstd uses to memorize the compressing data. (available: [10, 22], default: 0 (disables long mode.))
All of the above are different but somewhat in common from the point of compression process in that it impacts the memorize size during the process.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)