You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues-all@impala.apache.org by "David Mollitor (Jira)" <ji...@apache.org> on 2019/09/24 15:48:00 UTC
[jira] [Comment Edited] (IMPALA-2277) Investigate alternative hash
functions
[ https://issues.apache.org/jira/browse/IMPALA-2277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16936937#comment-16936937 ]
David Mollitor edited comment on IMPALA-2277 at 9/24/19 3:47 PM:
-----------------------------------------------------------------
At the very least, we need a hash algorithm that overlaps with Impala so that I can test compatibility between the two products.
I am currently trying to figure out if I can pass a Hive BINARY type as an IMPALA String Type, but I can't compare the two values without a hash routine that they both share.
https://cwiki.apache.org/confluence/display/Hive/LanguageManual+UDF
https://stackoverflow.com/questions/52226750/consistent-hive-and-impala-hash
was (Author: belugabehr):
At the very least, we need a hash algorithm that overlaps with Impala so that I can test compatibility between the two products.
I am currently trying to figure out if I can pass a Hive BINARY type as an IMPALA String Type, but I can't compare the two values without a hash routine that they both share.
https://cwiki.apache.org/confluence/display/Hive/LanguageManual+UDF
> Investigate alternative hash functions
> --------------------------------------
>
> Key: IMPALA-2277
> URL: https://issues.apache.org/jira/browse/IMPALA-2277
> Project: IMPALA
> Issue Type: Task
> Components: Backend
> Affects Versions: Impala 2.2
> Reporter: Tim Armstrong
> Priority: Minor
>
> Impala currently uses FNV, Murmur2 and CRC hashes in different places depending on requirements. There are additional, newer, hash functions available including Murmur3, SpookyHash, CityHash, and others that may offer benefits.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org