Vector search highlightings

[Sergio García Maroto <ma...@gmail.com>]

Hi,

I started working on adding vector search capabilities to solr.
I would like to know which would be the best strategy to give some kind of
highlighting on the results.
As we are working with numbers not sure if this even possible.

Thanks a lot
Sergio Maroto

Re: Vector search highlightings

[Alessandro Benedetti <a....@sease.io>]

We have developed a Neural Highlighting plugin already:
https://sease.io/2023/05/apache-solr-neural-highlighting-plugin.html

We are not planning to donate it yet but if we get some sponsor we may make
it available sooner rather than later!

Cheers

On Fri, 4 Oct 2024, 19:49 Robi Petersen, <ro...@gmail.com> wrote:

> I guess you'd have to keep a copy of your vectorized content in a stored
> only field so that you could get back to its original form and return it to
> the user
>
> On Fri, Oct 4, 2024, 11:47 AM Robi Petersen <ro...@gmail.com> wrote:
>
> > Not sure what the use case for that would be. The vectors themselves are
> > inscrutable. I suppose you could unvectorize the value that you got a hit
> > on somehow use that to match up to what was indexed into the vector in
> the
> > first place and display that text as a highlight. Maybe... Thinking the
> > vectors just add context to the token matching of solr but would be what
> > would be interesting would be if we could do that in a debug mode of some
> > kind and then like you could actually see what the vectors are are
> composed
> > of and be able to decide if it's working for you, again maybe?
> >
> > On Fri, Oct 4, 2024, 2:47 AM Sergio García Maroto <ma...@gmail.com>
> > wrote:
> >
> >> Hi,
> >>
> >> I started working on adding vector search capabilities to solr.
> >> I would like to know which would be the best strategy to give some kind
> of
> >> highlighting on the results.
> >> As we are working with numbers not sure if this even possible.
> >>
> >> Thanks a lot
> >> Sergio Maroto
> >>
> >
>

Re: Vector search highlightings

[Robi Petersen <ro...@gmail.com>]

I guess you'd have to keep a copy of your vectorized content in a stored
only field so that you could get back to its original form and return it to
the user

On Fri, Oct 4, 2024, 11:47 AM Robi Petersen <ro...@gmail.com> wrote:

> Not sure what the use case for that would be. The vectors themselves are
> inscrutable. I suppose you could unvectorize the value that you got a hit
> on somehow use that to match up to what was indexed into the vector in the
> first place and display that text as a highlight. Maybe... Thinking the
> vectors just add context to the token matching of solr but would be what
> would be interesting would be if we could do that in a debug mode of some
> kind and then like you could actually see what the vectors are are composed
> of and be able to decide if it's working for you, again maybe?
>
> On Fri, Oct 4, 2024, 2:47 AM Sergio García Maroto <ma...@gmail.com>
> wrote:
>
>> Hi,
>>
>> I started working on adding vector search capabilities to solr.
>> I would like to know which would be the best strategy to give some kind of
>> highlighting on the results.
>> As we are working with numbers not sure if this even possible.
>>
>> Thanks a lot
>> Sergio Maroto
>>
>

Re: Vector search highlightings

[Robi Petersen <ro...@gmail.com>]

Not sure what the use case for that would be. The vectors themselves are
inscrutable. I suppose you could unvectorize the value that you got a hit
on somehow use that to match up to what was indexed into the vector in the
first place and display that text as a highlight. Maybe... Thinking the
vectors just add context to the token matching of solr but would be what
would be interesting would be if we could do that in a debug mode of some
kind and then like you could actually see what the vectors are are composed
of and be able to decide if it's working for you, again maybe?

On Fri, Oct 4, 2024, 2:47 AM Sergio García Maroto <ma...@gmail.com>
wrote:

> Hi,
>
> I started working on adding vector search capabilities to solr.
> I would like to know which would be the best strategy to give some kind of
> highlighting on the results.
> As we are working with numbers not sure if this even possible.
>
> Thanks a lot
> Sergio Maroto
>