[jira] [Created] (SPARK-18454) Changes to fix Multi-Probe Nearest Neighbor Search for LSH

["Yun Ni (JIRA)" <ji...@apache.org>]

Yun Ni created SPARK-18454:
------------------------------

             Summary: Changes to fix Multi-Probe Nearest Neighbor Search for LSH
                 Key: SPARK-18454
                 URL: https://issues.apache.org/jira/browse/SPARK-18454
             Project: Spark
          Issue Type: Improvement
            Reporter: Yun Ni


We all agree to do the following improvement to Multi-Probe NN Search:
(1) Use approxQuantile to get the {{hashDistance}} threshold instead of doing full sort on the whole dataset

Currently we are still discussing the following:
(1) What {{hashDistance}} (or Probing Sequence) we should use for {{MinHash}}
(2) How we should change the current MultiProbe implementation to make it align with the MultiProbe NN Search from the origin paper: http://www.cs.princeton.edu/cass/papers/mplsh_vldb07.pdf



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org