You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@arrow.apache.org by "Antoine Pitrou (Jira)" <ji...@apache.org> on 2019/08/29 12:07:00 UTC

[jira] [Created] (ARROW-6385) [C++] Investigate xxh3

Antoine Pitrou created ARROW-6385:
-------------------------------------

             Summary: [C++] Investigate xxh3
                 Key: ARROW-6385
                 URL: https://issues.apache.org/jira/browse/ARROW-6385
             Project: Apache Arrow
          Issue Type: Task
          Components: Benchmarking, C++
            Reporter: Antoine Pitrou


xxh3 is a new hash algorithm by Yann Collet that claims excellent speed on both small/tiny and large keys. It has accelerated paths for x86 SSE2, AVX and ARM NEON. It also has excellent hash quality.
https://fastcompression.blogspot.com/2019/03/presenting-xxh3.html

Perhaps this can replace our current complex strategy involving a custom tiny string hashing implementation, a HW CRC32-based path where available for large strings, and a murmurhash2 fallback.



--
This message was sent by Atlassian Jira
(v8.3.2#803003)