[jira] [Created] (IMPALA-11603) Investigate using cloudflare's zlib library

["Joe McDonnell (Jira)" <ji...@apache.org>]

Joe McDonnell created IMPALA-11603:
--------------------------------------

             Summary: Investigate using cloudflare's zlib library
                 Key: IMPALA-11603
                 URL: https://issues.apache.org/jira/browse/IMPALA-11603
             Project: IMPALA
          Issue Type: Improvement
          Components: Backend
    Affects Versions: Impala 4.2.0
            Reporter: Joe McDonnell


Amazon recommends the use of cloudflare's zlib implementation at [https://github.com/cloudflare/zlib]

In a blog post, they claim pretty large performance boosts over the regular zlib implementation:

[https://aws.amazon.com/blogs/opensource/improving-zlib-cloudflare-and-comparing-performance-with-other-zlib-forks/]
{noformat}
On Arm:
  Compression performance: ~90 percent faster than zlib-madler (original zlib).
  Decompression performance: ~52 percent faster than zlib-madler.
On x86:
  Compression performance: ~113 percent faster than zlib-madler.
  Decompression performance: ~44 percent faster than zlib-madler.{noformat}
The blog post is a year and a half old, so things may have changed since then, but it seems interesting. Amazon's guidebooks still recommend it.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)