You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hive.apache.org by "Bruno P. Kinoshita (JIRA)" <ji...@apache.org> on 2015/04/12 14:53:12 UTC
[jira] [Commented] (HIVE-9557) create UDF to measure strings
similarity using Cosine Similarity algo
[ https://issues.apache.org/jira/browse/HIVE-9557?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14491457#comment-14491457 ]
Bruno P. Kinoshita commented on HIVE-9557:
------------------------------------------
Hi,
We are implementing several string similarity algorithms in the sandbox component [Commons-Text|http://commons.apache.org/sandbox/commons-text/]. It would be great if this UDF could be written using that component.
> create UDF to measure strings similarity using Cosine Similarity algo
> ---------------------------------------------------------------------
>
> Key: HIVE-9557
> URL: https://issues.apache.org/jira/browse/HIVE-9557
> Project: Hive
> Issue Type: Improvement
> Components: UDF
> Reporter: Alexander Pivovarov
> Assignee: Alexander Pivovarov
>
> algo description http://en.wikipedia.org/wiki/Cosine_similarity
> {code}
> --one word different, total 2 words
> str_sim_cosine('Test String1', 'Test String2') = (2 - 1) / 2 = 0.5f
> {code}
> reference implementation:
> https://github.com/Simmetrics/simmetrics/blob/master/src/uk/ac/shef/wit/simmetrics/similaritymetrics/CosineSimilarity.java
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)