You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@pulsar.apache.org by "Ultranium (via GitHub)" <gi...@apache.org> on 2025/03/14 18:39:29 UTC

[D] Customize compression codec for filesystem offloader [pulsar]

GitHub user Ultranium created a discussion: Customize compression codec for filesystem offloader

I'd like to ask is it possible to customize compression codec for filesystem offloader?

The filesystem offloader is implemented on top of Hadoop client, and offloaded files seems to be encoded using the `org.apache.hadoop.io.compress.DefaultCodec`, which compresses data with DEFLATE algorithm.

Is it possible to customize it to other codecs supported by Hadoop, like Lz4Codec or ZstandardCodec?

GitHub link: https://github.com/apache/pulsar/discussions/24078

----
This is an automatically sent email for commits@pulsar.apache.org.
To unsubscribe, please send an email to: commits-unsubscribe@pulsar.apache.org