You are viewing a plain text version of this content. The canonical link for it is here.
Posted to solr-user@lucene.apache.org by Mark Robinson <ma...@gmail.com> on 2020/10/27 15:42:02 UTC
Avoiding single digit and single charcater ONLY query by putting them
in stopwords list
Hello,
I want to block queries having only a digit like "1" or "2" , ... or
just a letter like "a" or "b" ...
Is it a good idea to block them ... ie just single digits 0 - 9 and a - z
by putting them as a stop word? The problem with this I can anticipate is a
query like "1 inch screw" can have the important information "1" stripped
out if I tokenize it.
So what would be a good way to avoid single digit only and single letter
only queries, from the Solr end?
Or should I not do this at the Solr end at all?
Could someone please share your thoughts?
Thanks!
Mark
Re: Avoiding single digit and single charcater ONLY query by putting
them in stopwords list
Posted by Mark Robinson <ma...@gmail.com>.
Thanks!
Mark
On Tue, Oct 27, 2020 at 11:56 AM Dave <ha...@gmail.com> wrote:
> Agreed. Just a JavaScript check on the input box would work fine for 99%
> of cases, unless something automatic is running them in which case just
> server side redirect back to the form.
>
> > On Oct 27, 2020, at 11:54 AM, Mark Robinson <ma...@gmail.com>
> wrote:
> >
> > Hi Konstantinos ,
> >
> > Thanks for the reply.
> > I too feel the same. Wanted to find what others also in the Solr world
> > thought about it.
> >
> > Thanks!
> > Mark.
> >
> >> On Tue, Oct 27, 2020 at 11:45 AM Konstantinos Koukouvis <
> >> konstantinos.koukouvis@mecenat.com> wrote:
> >>
> >> Oh hi Mark!
> >>
> >> Why would you wanna do such a thing in the solr end. Imho it would be
> much
> >> more clean and easy to do it on the client side
> >>
> >> Regards,
> >> Konstantinos
> >>
> >>
> >>>> On 27 Oct 2020, at 16:42, Mark Robinson <ma...@gmail.com>
> wrote:
> >>>
> >>> Hello,
> >>>
> >>> I want to block queries having only a digit like "1" or "2" , ... or
> >>> just a letter like "a" or "b" ...
> >>>
> >>> Is it a good idea to block them ... ie just single digits 0 - 9 and a
> -
> >> z
> >>> by putting them as a stop word? The problem with this I can anticipate
> >> is a
> >>> query like "1 inch screw" can have the important information "1"
> stripped
> >>> out if I tokenize it.
> >>>
> >>> So what would be a good way to avoid single digit only and single
> letter
> >>> only queries, from the Solr end?
> >>> Or should I not do this at the Solr end at all?
> >>>
> >>> Could someone please share your thoughts?
> >>>
> >>> Thanks!
> >>> Mark
> >>
> >> ==================================================
> >> Konstantinos Koukouvis
> >> konstantinos.koukouvis@mecenat.com
> >>
> >> Using Golang and Solr? Try this: https://github.com/mecenat/solr
> >>
> >>
> >>
> >>
> >>
> >>
>
Re: Avoiding single digit and single charcater ONLY query by putting them in stopwords list
Posted by Dave <ha...@gmail.com>.
Agreed. Just a JavaScript check on the input box would work fine for 99% of cases, unless something automatic is running them in which case just server side redirect back to the form.
> On Oct 27, 2020, at 11:54 AM, Mark Robinson <ma...@gmail.com> wrote:
>
> Hi Konstantinos ,
>
> Thanks for the reply.
> I too feel the same. Wanted to find what others also in the Solr world
> thought about it.
>
> Thanks!
> Mark.
>
>> On Tue, Oct 27, 2020 at 11:45 AM Konstantinos Koukouvis <
>> konstantinos.koukouvis@mecenat.com> wrote:
>>
>> Oh hi Mark!
>>
>> Why would you wanna do such a thing in the solr end. Imho it would be much
>> more clean and easy to do it on the client side
>>
>> Regards,
>> Konstantinos
>>
>>
>>>> On 27 Oct 2020, at 16:42, Mark Robinson <ma...@gmail.com> wrote:
>>>
>>> Hello,
>>>
>>> I want to block queries having only a digit like "1" or "2" , ... or
>>> just a letter like "a" or "b" ...
>>>
>>> Is it a good idea to block them ... ie just single digits 0 - 9 and a -
>> z
>>> by putting them as a stop word? The problem with this I can anticipate
>> is a
>>> query like "1 inch screw" can have the important information "1" stripped
>>> out if I tokenize it.
>>>
>>> So what would be a good way to avoid single digit only and single letter
>>> only queries, from the Solr end?
>>> Or should I not do this at the Solr end at all?
>>>
>>> Could someone please share your thoughts?
>>>
>>> Thanks!
>>> Mark
>>
>> ==================================================
>> Konstantinos Koukouvis
>> konstantinos.koukouvis@mecenat.com
>>
>> Using Golang and Solr? Try this: https://github.com/mecenat/solr
>>
>>
>>
>>
>>
>>
Re: Avoiding single digit and single charcater ONLY query by putting
them in stopwords list
Posted by Mark Robinson <ma...@gmail.com>.
Hi Konstantinos ,
Thanks for the reply.
I too feel the same. Wanted to find what others also in the Solr world
thought about it.
Thanks!
Mark.
On Tue, Oct 27, 2020 at 11:45 AM Konstantinos Koukouvis <
konstantinos.koukouvis@mecenat.com> wrote:
> Oh hi Mark!
>
> Why would you wanna do such a thing in the solr end. Imho it would be much
> more clean and easy to do it on the client side
>
> Regards,
> Konstantinos
>
>
> > On 27 Oct 2020, at 16:42, Mark Robinson <ma...@gmail.com> wrote:
> >
> > Hello,
> >
> > I want to block queries having only a digit like "1" or "2" , ... or
> > just a letter like "a" or "b" ...
> >
> > Is it a good idea to block them ... ie just single digits 0 - 9 and a -
> z
> > by putting them as a stop word? The problem with this I can anticipate
> is a
> > query like "1 inch screw" can have the important information "1" stripped
> > out if I tokenize it.
> >
> > So what would be a good way to avoid single digit only and single letter
> > only queries, from the Solr end?
> > Or should I not do this at the Solr end at all?
> >
> > Could someone please share your thoughts?
> >
> > Thanks!
> > Mark
>
> ==================================================
> Konstantinos Koukouvis
> konstantinos.koukouvis@mecenat.com
>
> Using Golang and Solr? Try this: https://github.com/mecenat/solr
>
>
>
>
>
>
Re: Avoiding single digit and single charcater ONLY query by putting
them in stopwords list
Posted by Konstantinos Koukouvis <ko...@mecenat.com>.
Oh hi Mark!
Why would you wanna do such a thing in the solr end. Imho it would be much more clean and easy to do it on the client side
Regards,
Konstantinos
> On 27 Oct 2020, at 16:42, Mark Robinson <ma...@gmail.com> wrote:
>
> Hello,
>
> I want to block queries having only a digit like "1" or "2" , ... or
> just a letter like "a" or "b" ...
>
> Is it a good idea to block them ... ie just single digits 0 - 9 and a - z
> by putting them as a stop word? The problem with this I can anticipate is a
> query like "1 inch screw" can have the important information "1" stripped
> out if I tokenize it.
>
> So what would be a good way to avoid single digit only and single letter
> only queries, from the Solr end?
> Or should I not do this at the Solr end at all?
>
> Could someone please share your thoughts?
>
> Thanks!
> Mark
==================================================
Konstantinos Koukouvis
konstantinos.koukouvis@mecenat.com
Using Golang and Solr? Try this: https://github.com/mecenat/solr