You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@lucene.apache.org by "Julie Tibshirani (Jira)" <ji...@apache.org> on 2021/09/16 00:27:00 UTC

[jira] [Created] (LUCENE-10109) Increase default 'beam width' for HNSW

Julie Tibshirani created LUCENE-10109:
-----------------------------------------

             Summary: Increase default 'beam width' for HNSW
                 Key: LUCENE-10109
                 URL: https://issues.apache.org/jira/browse/LUCENE-10109
             Project: Lucene - Core
          Issue Type: Improvement
            Reporter: Julie Tibshirani


{{Lucene90HnswVectorsFormat}} has a default 'beam width' of 16. This is quite low and doesn't produce good recall on typical-sized datasets. Lucene's 'beam width' roughly corresponds to the efConstruction parameter in HNSW. As a reference, the runs in ann-benchmarks set efConstruction between ~400 and 800, most common seems to be 500.

I think we should bump the default for beam width to something like 100 or 500 to produce decent results out-of-the-box. I don't think it will slow down tests too much, but we could always set it lower in tests if necessary.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@lucene.apache.org
For additional commands, e-mail: issues-help@lucene.apache.org