Re: Suggester Behavior

[Will Butler <wi...@wellspring.com>]

Hi Mikhail,

I believe that we tried it out with both the DocumentDictionaryFactory and
the HighFrequencyDictionaryFactory.

Thanks,

Will

On Wed, Jan 5, 2022 at 2:08 PM Mikhail Khludnev <mk...@apache.org> wrote:

> Hi, Will.
> Which dictionary implementation do you use?
>
> On Wed, Jan 5, 2022 at 7:16 PM Will Butler <wi...@wellspring.com>
> wrote:
>
> > When using the suggest component, the stored value from the configured
> > `field` is generally used to populate the dictionary. However, regardless
> > of the configured `lookupImpl` and `suggestAnalyzerFieldType`, it seems
> > that the returned suggestions are based on the indexed value rather than
> > the full stored value. For example, one of our text field types uses the
> > `WordDelimiterGraphFilterFactory`. When using a field with this type for
> > suggestions, we often end up with concatenated forms of hyphenated words
> in
> > the results regardless to of the `suggestAnalyzerFieldType`
> configuration.
> > Is this expected? Am I missing a configuration option that will prevent
> > this from occuring?
> >
> > Thanks,
> >
> > Will
> >
> > --
> > Confidentiality Notice: This email is intended only for the use of the
> > individual or entity to which it is addressed and may contain information
> > that is privileged, confidential, and exempt from disclosure under
> > applicable law.  If you have received this communication in error, please
> > do not distribute; rather, notify the sender by e-mail at the address
> shown
> > above and delete the original message with any attachments.
> >
> >
> > --
> >
> >
> > This email and any files transmitted with it are confidential and
> > intended solely for the use of the individual or entity to whom they are
> > addressed. If you have received this email in error please notify the
> > system manager. This message contains confidential information and is
> > intended only for the individual named. If you are not the named
> addressee
> > you should not disseminate, distribute or copy this e-mail. Please notify
> > the sender immediately by e-mail if you have received this e-mail by
> > mistake and delete this e-mail from your system. If you are not the
> > intended recipient you are notified that disclosing, copying,
> distributing
> > or taking any action in reliance on the contents of this information is
> > strictly prohibited.
> >
>
>
> --
> Sincerely yours
> Mikhail Khludnev
>


-- 
Confidentiality Notice: This email is intended only for the use of the
individual or entity to which it is addressed and may contain information
that is privileged, confidential, and exempt from disclosure under
applicable law. If you have received this communication in error, please do
not distribute; rather, notify the sender by e-mail at the address shown
above and delete the original message with any attachments.

-- 


This email and any files transmitted with it are confidential and 
intended solely for the use of the individual or entity to whom they are 
addressed. If you have received this email in error please notify the 
system manager. This message contains confidential information and is 
intended only for the individual named. If you are not the named addressee 
you should not disseminate, distribute or copy this e-mail. Please notify 
the sender immediately by e-mail if you have received this e-mail by 
mistake and delete this e-mail from your system. If you are not the 
intended recipient you are notified that disclosing, copying, distributing 
or taking any action in reliance on the contents of this information is 
strictly prohibited.

Re: Suggester Behavior

[Mikhail Khludnev <mk...@apache.org>]

Hi, Will.
I can only say that HighFrequencyDictionaryFactory supplies indexed
(analyzed) terms that definitely may cause the issue you describe, but
DocumentDictionaryFactory seems to use stored original value. Make sure you
rebuild suggester after changing the dictionary, and I don't know if any
`clean` is required before.

On Sat, Feb 5, 2022 at 8:47 AM Will Butler <wi...@wellspring.com>
wrote:

> Hi Mikhail,
>
> I believe that we tried it out with both the DocumentDictionaryFactory and
> the HighFrequencyDictionaryFactory.
>
> Thanks,
>
> Will
>
> On Wed, Jan 5, 2022 at 2:08 PM Mikhail Khludnev <mk...@apache.org> wrote:
>
> > Hi, Will.
> > Which dictionary implementation do you use?
> >
> > On Wed, Jan 5, 2022 at 7:16 PM Will Butler <wi...@wellspring.com>
> > wrote:
> >
> > > When using the suggest component, the stored value from the configured
> > > `field` is generally used to populate the dictionary. However,
> regardless
> > > of the configured `lookupImpl` and `suggestAnalyzerFieldType`, it seems
> > > that the returned suggestions are based on the indexed value rather
> than
> > > the full stored value. For example, one of our text field types uses
> the
> > > `WordDelimiterGraphFilterFactory`. When using a field with this type
> for
> > > suggestions, we often end up with concatenated forms of hyphenated
> words
> > in
> > > the results regardless to of the `suggestAnalyzerFieldType`
> > configuration.
> > > Is this expected? Am I missing a configuration option that will prevent
> > > this from occuring?
> > >
> > > Thanks,
> > >
> > > Will
> > >
> > > --
> > > Confidentiality Notice: This email is intended only for the use of the
> > > individual or entity to which it is addressed and may contain
> information
> > > that is privileged, confidential, and exempt from disclosure under
> > > applicable law.  If you have received this communication in error,
> please
> > > do not distribute; rather, notify the sender by e-mail at the address
> > shown
> > > above and delete the original message with any attachments.
> > >
> > >
> > > --
> > >
> > >
> > > This email and any files transmitted with it are confidential and
> > > intended solely for the use of the individual or entity to whom they
> are
> > > addressed. If you have received this email in error please notify the
> > > system manager. This message contains confidential information and is
> > > intended only for the individual named. If you are not the named
> > addressee
> > > you should not disseminate, distribute or copy this e-mail. Please
> notify
> > > the sender immediately by e-mail if you have received this e-mail by
> > > mistake and delete this e-mail from your system. If you are not the
> > > intended recipient you are notified that disclosing, copying,
> > distributing
> > > or taking any action in reliance on the contents of this information is
> > > strictly prohibited.
> > >
> >
> >
> > --
> > Sincerely yours
> > Mikhail Khludnev
> >
>
>
> --
> Confidentiality Notice: This email is intended only for the use of the
> individual or entity to which it is addressed and may contain information
> that is privileged, confidential, and exempt from disclosure under
> applicable law. If you have received this communication in error, please do
> not distribute; rather, notify the sender by e-mail at the address shown
> above and delete the original message with any attachments.
>
> --
>
>
> This email and any files transmitted with it are confidential and
> intended solely for the use of the individual or entity to whom they are
> addressed. If you have received this email in error please notify the
> system manager. This message contains confidential information and is
> intended only for the individual named. If you are not the named addressee
> you should not disseminate, distribute or copy this e-mail. Please notify
> the sender immediately by e-mail if you have received this e-mail by
> mistake and delete this e-mail from your system. If you are not the
> intended recipient you are notified that disclosing, copying, distributing
> or taking any action in reliance on the contents of this information is
> strictly prohibited.
>


-- 
Sincerely yours
Mikhail Khludnev