[GitHub] [lucene] FranciscoBorges commented on issue #11507: Increase the number of dims for KNN vectors to 2048 [LUCENE-10471]

["FranciscoBorges (via GitHub)" <gi...@apache.org>]

FranciscoBorges commented on issue #11507:
URL: https://github.com/apache/lucene/issues/11507#issuecomment-1533718841

   @uschindler @rmuir FWIW We are interested in using Lucene's kNN with 1536 dimensions in order to use OpenAI's embeddings API. We benchmarked a patched Lucene/Solr. We fully understand (we measured it :-P) that there is an increase in memory consumption and latency. Sure thing.
   
   We have applications where dev teams have chosen to work with OpenAI embeddings and where the number of records involved and requests per second make the trade offs of memory and latency perfectly acceptable.
   
   There is a great deal of enthusiasm around OpenAI and releasing a working application ASAP. For many of these the resource cost of 1536 dimensions is perfectly acceptable against the alternative of delaying a pilot to optimize further.
   
   Our work would be a lot easier if Lucene's kNN implementation supported 1536 dimensions without need for a patch.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@lucene.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@lucene.apache.org
For additional commands, e-mail: issues-help@lucene.apache.org