You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@lucene.apache.org by "benwtrent (via GitHub)" <gi...@apache.org> on 2024/11/22 19:02:45 UTC
[I] Should we add a new "BulkScoreVectors" type api to the vector scorer interfaces? [lucene]
benwtrent opened a new issue, #14013:
URL: https://github.com/apache/lucene/issues/14013
### Description
With pre-fetching and newer quantization methods (e.g. the currently WIP bit quantization technique), it might be beneficial to have a clean interface indicating you want the scores for a handful of vectors.
I can see this helping with HNSW by allowing exploration to prefetch and then score all neighbors of the current candidate vector.
For higher levels of quantization quantization, since multiple corrective values need to be applied to the scored outputs, its conceivable that these corrections could be vectorized if multiple vectors were scored at the same time.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@lucene.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@lucene.apache.org
For additional commands, e-mail: issues-help@lucene.apache.org
Re: [I] Should we add a new "BulkScoreVectors" type api to the vector scorer interfaces? [lucene]
Posted by "benwtrent (via GitHub)" <gi...@apache.org>.
benwtrent closed issue #14013: Should we add a new "BulkScoreVectors" type api to the vector scorer interfaces?
URL: https://github.com/apache/lucene/issues/14013
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@lucene.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@lucene.apache.org
For additional commands, e-mail: issues-help@lucene.apache.org
Re: [I] Should we add a new "BulkScoreVectors" type api to the vector scorer interfaces? [lucene]
Posted by "benwtrent (via GitHub)" <gi...@apache.org>.
benwtrent commented on issue #14013:
URL: https://github.com/apache/lucene/issues/14013#issuecomment-3353386183
@mccullocht has knocked this one out! I think this is now finished.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@lucene.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@lucene.apache.org
For additional commands, e-mail: issues-help@lucene.apache.org
Re: [I] Should we add a new "BulkScoreVectors" type api to the vector scorer interfaces? [lucene]
Posted by "benwtrent (via GitHub)" <gi...@apache.org>.
benwtrent commented on issue #14013:
URL: https://github.com/apache/lucene/issues/14013#issuecomment-3058819130
@mccullocht
Given the recent conversation on the Lucene list about making HNSW search faster.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@lucene.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@lucene.apache.org
For additional commands, e-mail: issues-help@lucene.apache.org
Re: [I] Should we add a new "BulkScoreVectors" type api to the vector scorer interfaces? [lucene]
Posted by "mccullocht (via GitHub)" <gi...@apache.org>.
mccullocht commented on issue #14013:
URL: https://github.com/apache/lucene/issues/14013#issuecomment-3059230678
Breadcrumb back to the mailing list discussion: https://lists.apache.org/thread/obc84kp3mxmd9nrbpxyj8bt0hbzfpxwv
There's some evidence to suggest that a bulk scoring API would allow us optimize scoring directly or introduce cpu cache prefetching if we call into native code. I'm planning to spend time on this.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@lucene.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@lucene.apache.org
For additional commands, e-mail: issues-help@lucene.apache.org