You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@kafka.apache.org by "Dongjin Lee (Jira)" <ji...@apache.org> on 2021/10/10 12:16:00 UTC

[jira] [Created] (KAFKA-13361) Support fine-grained compression options

Dongjin Lee created KAFKA-13361:
-----------------------------------

             Summary: Support fine-grained compression options
                 Key: KAFKA-13361
                 URL: https://issues.apache.org/jira/browse/KAFKA-13361
             Project: Kafka
          Issue Type: Improvement
          Components: clients, core
            Reporter: Dongjin Lee
            Assignee: Dongjin Lee


Adds the following options into the Producer, Broker, and Topic configurations:
 * compression.gzip.buffer: the buffer size that feeds raw input into the Deflator or is fed by the uncompressed output from the Deflator. (available: [512, ), default: 8192(=8kb).)
 * compression.snappy.block: the block size that snappy uses. (available: [1024, ), default: 32768(=32kb).)
 * compression.lz4.block: the block size that lz4 uses. (available: [4, 7], (means 64kb, 256kb, 1mb, 4mb respectively), default: 4.)
 * compression.zstd.window: enables long mode; the log of the window size that zstd uses to memorize the compressing data. (available: [10, 22], default: 0 (disables long mode.))

All of the above are different but somewhat in common from the point of compression process in that it impacts the memorize size during the process.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)