[jira] [Created] (IMPALA-9997) Update to a newer version of LZ4

["Joe McDonnell (Jira)" <ji...@apache.org>]

Joe McDonnell created IMPALA-9997:
-------------------------------------

             Summary: Update to a newer version of LZ4
                 Key: IMPALA-9997
                 URL: https://issues.apache.org/jira/browse/IMPALA-9997
             Project: IMPALA
          Issue Type: Improvement
          Components: Backend
    Affects Versions: Impala 4.0
            Reporter: Joe McDonnell


Impala currently uses LZ4 version 1.7.5. The LZ4 project lists several performance improvements in later versions:

 
{noformat}
v1.9.0
perf: large decompression speed improvement on x86/x64 (up to +20%) by @djwatson
...
v1.8.3
perf: minor decompression speed improvement (~+2%) with gcc
...
v1.8.2
perf: *much* faster dictionary compression on small files, by @felixhandte
perf: improved decompression speed and binary size, by Alexey Tourbin (@svpv)
perf: slightly faster HC compression and decompression speed
perf: very small compression ratio improvement
...
v1.8.1
perf : faster and stronger ultra modes (levels 10+)
perf : slightly faster compression and decompression speed
perf : fix bad degenerative case, reported by @c-morgenstern
...{noformat}
[https://github.com/lz4/lz4/blob/dev/NEWS]

 

 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)