Re: [I] [C++][Compute] Add scalar_hash function [arrow]

["granthamtaylor (via GitHub)" <gi...@apache.org>]

granthamtaylor commented on issue #17211:
URL: https://github.com/apache/arrow/issues/17211#issuecomment-5622446710

   Hi folks, is this in the works?
   
   I have a use case for the feature I would love to see resolved.
   
   In [relflow](https://relflow.ai), I am hashing scalar values in nested arrays to safely represent arbitrary values (phone numbers, emails, credit cards numbers, etc) within n-dimensional contexts.
   
   The hash function only needs to be consistent within a batch such that the model cannot overfit to any actual values - only the equalities among values within a context (IE: "for what other financial transactions / clickstream events has this customer authenticated with this arbitrary phone number?")
   
   I am currently moving the arrow data over to a polars series (which does support such scalar hashing). This is reasonably cheap but I would love an arrow-native solution !
   
   Happy to help / contribute.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org