You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@pulsar.apache.org by GitBox <gi...@apache.org> on 2021/07/28 08:48:45 UTC
[GitHub] [pulsar] skyguard1 opened a new issue #11471: Support brotli compression algorithm
skyguard1 opened a new issue #11471:
URL: https://github.com/apache/pulsar/issues/11471
`Brotli` is a high performance, high compression ratio compression algorithm. Does Pulsar plan to support this compression algorithm? If yes, I can provide a pr, see https://github.com/google/brotli, thanks
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pulsar.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [pulsar] hpvd commented on issue #11471: Support brotli compression algorithm
Posted by GitBox <gi...@apache.org>.
hpvd commented on issue #11471:
URL: https://github.com/apache/pulsar/issues/11471#issuecomment-888557339
just edited comment above
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pulsar.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [pulsar] hpvd edited a comment on issue #11471: Support brotli compression algorithm
Posted by GitBox <gi...@apache.org>.
hpvd edited a comment on issue #11471:
URL: https://github.com/apache/pulsar/issues/11471#issuecomment-888552193
...It's all about finding the best balance (most cost-efficient) between storage/network/compute
for the use case: save storage and network bandwidth (e.g. factor 2-3) and pay with a little compute (e.g. 2-10%)
pulsar today supports LZ4, ZLIB, ZSTD, SNAPPY
see https://pulsar.apache.org/docs/en/concepts-messaging/#compression
just some interesting inside from competition, including benchmarks of different algorithms incl brotli
https://blog.cloudflare.com/squeezing-the-firehose/
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pulsar.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [pulsar] hpvd edited a comment on issue #11471: Support brotli compression algorithm
Posted by GitBox <gi...@apache.org>.
hpvd edited a comment on issue #11471:
URL: https://github.com/apache/pulsar/issues/11471#issuecomment-888552193
...It's all about finding the best balance (most cost-efficient) between storage/network/compute
for the use case: save storage and network bandwidth (e.g. factor 2-3) and pay with a little compute (e.g. 2-10%)
pulsar supports LZ4, ZLIB, ZSTD, SNAPPY
se https://pulsar.apache.org/docs/en/concepts-messaging/#compression
just some interesting inside from competition, including benchmarks of different algorithms incl brotli
https://blog.cloudflare.com/squeezing-the-firehose/
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pulsar.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [pulsar] hpvd removed a comment on issue #11471: Support brotli compression algorithm
Posted by GitBox <gi...@apache.org>.
hpvd removed a comment on issue #11471:
URL: https://github.com/apache/pulsar/issues/11471#issuecomment-888557339
just edited comment above
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pulsar.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [pulsar] hpvd commented on issue #11471: Support brotli compression algorithm
Posted by GitBox <gi...@apache.org>.
hpvd commented on issue #11471:
URL: https://github.com/apache/pulsar/issues/11471#issuecomment-888574056
opened a related issue regarding doc of compression feature in pulsar: https://github.com/apache/pulsar/issues/11489
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pulsar.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [pulsar] hpvd edited a comment on issue #11471: Support brotli compression algorithm
Posted by GitBox <gi...@apache.org>.
hpvd edited a comment on issue #11471:
URL: https://github.com/apache/pulsar/issues/11471#issuecomment-888552193
...It's all about finding the best balance (most cost-efficient) between storage/network/compute
for the use case: save storage and network bandwidth (e.g. factor 2-3) and pay with a little compute (e.g. 2-10%)
pulsar supports https://pulsar.apache.org/docs/en/concepts-messaging/#compression
just some interesting inside from competition, including benchmarks of different algorithms incl brotli
https://blog.cloudflare.com/squeezing-the-firehose/
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pulsar.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [pulsar] hpvd commented on issue #11471: Support brotli compression algorithm
Posted by GitBox <gi...@apache.org>.
hpvd commented on issue #11471:
URL: https://github.com/apache/pulsar/issues/11471#issuecomment-888552193
just some interesting inside from competition
(including benchmarks of different algorithms)
It's all about finding the best balance (most cost-efficient) between storage/network/compute
for the use case: save storage and network bandwidth and pay with compute
https://blog.cloudflare.com/squeezing-the-firehose/
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pulsar.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [pulsar] hpvd edited a comment on issue #11471: Support brotli compression algorithm
Posted by GitBox <gi...@apache.org>.
hpvd edited a comment on issue #11471:
URL: https://github.com/apache/pulsar/issues/11471#issuecomment-888552193
...It's all about finding the best balance (most cost-efficient) between storage/network/compute
for the use case: save storage and network bandwidth (e.g. factor 2-3) and pay with a little compute (e.g. 2-10%)
pulsar today supports LZ4, ZLIB, ZSTD, SNAPPY
se https://pulsar.apache.org/docs/en/concepts-messaging/#compression
just some interesting inside from competition, including benchmarks of different algorithms incl brotli
https://blog.cloudflare.com/squeezing-the-firehose/
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pulsar.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [pulsar] hpvd edited a comment on issue #11471: Support brotli compression algorithm
Posted by GitBox <gi...@apache.org>.
hpvd edited a comment on issue #11471:
URL: https://github.com/apache/pulsar/issues/11471#issuecomment-888552193
just some interesting inside from competition
(including benchmarks of different algorithms)
It's all about finding the best balance (most cost-efficient) between storage/network/compute
for the use case: save storage and network bandwidth (e.g. factor 2-3) and pay with a little compute (e.g. 2-10%)
https://blog.cloudflare.com/squeezing-the-firehose/
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pulsar.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [pulsar] hpvd edited a comment on issue #11471: Support brotli compression algorithm
Posted by GitBox <gi...@apache.org>.
hpvd edited a comment on issue #11471:
URL: https://github.com/apache/pulsar/issues/11471#issuecomment-888552193
...It's all about finding the best balance (most cost-efficient) between storage/network/compute
for the use case: save storage and network bandwidth (e.g. factor 2-3) and pay with a little compute (e.g. 2-10%)
pulsar today supports LZ4, ZLIB, ZSTD, SNAPPY
see https://pulsar.apache.org/docs/en/concepts-messaging/#compression
just some interesting inside from competition, including benchmarks of different algorithms
https://blog.cloudflare.com/squeezing-the-firehose/
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pulsar.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [pulsar] codelipenghui commented on issue #11471: Support brotli compression algorithm
Posted by GitBox <gi...@apache.org>.
codelipenghui commented on issue #11471:
URL: https://github.com/apache/pulsar/issues/11471#issuecomment-1058887807
The issue had no activity for 30 days, mark with Stale label.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pulsar.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org