You are viewing a plain text version of this content. The canonical link for it is here.
Posted to java-user@lucene.apache.org by Chellasamy G <ch...@zohocorp.com> on 2018/05/23 06:35:57 UTC
Case Insensitive Search for StringField
Hi,
I can't find any way to perform case insensitive search on StringField. Please help me out.
i.e If the field value is "Flying Robots", then the phrases "flying robots", "fLying RObots" etc should match the value.
I also need the original case of the field value to be preserved in the search results.
Thanks,
Satyan
Re: Case Insensitive Search for StringField
Posted by Chellasamy G <ch...@zohocorp.com>.
keyword tokenizer + lowercase filter resolved my problem.
Thank you all,
Satyan
---- On Sat, 26 May 2018 04:03:32 +0530 Ahmet Arslan <iorixxx@yahoo.com.INVALID> wrote ----
Hi,
string_ci type could be constructed from: keyword tokenizer + lowercase filter + may be trim filter.
Ahmet
On Friday, May 25, 2018, 1:50:19 PM GMT+3, Chellasamy G <chellasamy.g@zohocorp.com> wrote:
Hi Team,
Kindly help me out with this problem.
Thanks,
Satyan
---- On Wed, 23 May 2018 15:01:39 +0530 Chellasamy G &lt;chellasamy.g@zohocorp.com&gt; wrote ----
Hi,
Thanks for the reply.
Actually I need to implement it for StringField which is non-analyzed. So, if I am not wrong I can't add the analyzer for StringField.
My scenario is something similar to the one discussed in the below thread,
https://discuss.elastic.co/t/es-5-0-case-insensitive-search-for-keyword-fields/64111/10
Could you please let me know how to do the same the thing in lucene.
Thanks,
Satyan
---- On Wed, 23 May 2018 12:09:31 +0530 Adrien Grand &amp;lt;jpountz@gmail.com&amp;gt; wrote ----
Hi Satyan,
You need to add a LowercaseTokenFilter to your analysis chain. The way to
do it depends on how you are building your analyzer today (pre-built
analyzer, extending Analyzer or using CustomAnalyzer). This will preserve
the original case in field values because lowercasing will only be applied
to the content of the inverted index, not stored fields where hits are
fetched from.
Le mer. 23 mai 2018 à 08:36, Chellasamy G &amp;lt;chellasamy.g@zohocorp.com&amp;gt; a
écrit :
&amp;gt;
&amp;gt;
&amp;gt; Hi,
&amp;gt;
&amp;gt;
&amp;gt;
&amp;gt; I can't find any way to perform case insensitive search on StringField.
&amp;gt; Please help me out.
&amp;gt;
&amp;gt;
&amp;gt;
&amp;gt;
&amp;gt;
&amp;gt; i.e If the field value is "Flying Robots", then the phrases "flying
&amp;gt; robots", "fLying RObots" etc should match the value.
&amp;gt;
&amp;gt;
&amp;gt;
&amp;gt;
&amp;gt;
&amp;gt; I also need the original case of the field value to be preserved in the
&amp;gt; search results.
&amp;gt;
&amp;gt;
&amp;gt;
&amp;gt;
&amp;gt;
&amp;gt; Thanks,
&amp;gt;
&amp;gt; Satyan
&amp;gt;
&amp;gt;
&amp;gt;
&amp;gt;
Re: Case Insensitive Search for StringField
Posted by Ahmet Arslan <io...@yahoo.com.INVALID>.
Hi,
string_ci type could be constructed from: keyword tokenizer + lowercase filter + may be trim filter.
Ahmet
On Friday, May 25, 2018, 1:50:19 PM GMT+3, Chellasamy G <ch...@zohocorp.com> wrote:
Hi Team,
Kindly help me out with this problem.
Thanks,
Satyan
---- On Wed, 23 May 2018 15:01:39 +0530 Chellasamy G <chellasamy.g@zohocorp.com> wrote ----
Hi,
Thanks for the reply.
Actually I need to implement it for StringField which is non-analyzed. So, if I am not wrong I can't add the analyzer for StringField.
My scenario is something similar to the one discussed in the below thread,
https://discuss.elastic.co/t/es-5-0-case-insensitive-search-for-keyword-fields/64111/10
Could you please let me know how to do the same the thing in lucene.
Thanks,
Satyan
---- On Wed, 23 May 2018 12:09:31 +0530 Adrien Grand &lt;jpountz@gmail.com&gt; wrote ----
Hi Satyan,
You need to add a LowercaseTokenFilter to your analysis chain. The way to
do it depends on how you are building your analyzer today (pre-built
analyzer, extending Analyzer or using CustomAnalyzer). This will preserve
the original case in field values because lowercasing will only be applied
to the content of the inverted index, not stored fields where hits are
fetched from.
Le mer. 23 mai 2018 à 08:36, Chellasamy G &lt;chellasamy.g@zohocorp.com&gt; a
écrit :
&gt;
&gt;
&gt; Hi,
&gt;
&gt;
&gt;
&gt; I can't find any way to perform case insensitive search on StringField.
&gt; Please help me out.
&gt;
&gt;
&gt;
&gt;
&gt;
&gt; i.e If the field value is "Flying Robots", then the phrases "flying
&gt; robots", "fLying RObots" etc should match the value.
&gt;
&gt;
&gt;
&gt;
&gt;
&gt; I also need the original case of the field value to be preserved in the
&gt; search results.
&gt;
&gt;
&gt;
&gt;
&gt;
&gt; Thanks,
&gt;
&gt; Satyan
&gt;
&gt;
&gt;
&gt;
Re: Case Insensitive Search for StringField
Posted by Michael Sokolov <ms...@gmail.com>.
It's hard to help you because you haven't really explained what the problem
is. You say you must use StringField, which is a non analysed field, but
you also want to lower case the text values in the field, which requires
analysis.
I would suggest that you probably want to use TextField with a lowercase
analyzer, but that is contrary to your stated requirements. It maybe you
can just do the lower casing outside of lucene.
So I guess if you want help you'll need to explain your problem better.
On Fri, May 25, 2018, 6:50 AM Chellasamy G <ch...@zohocorp.com>
wrote:
>
>
> Hi Team,
>
>
>
>
>
> Kindly help me out with this problem.
>
>
>
>
>
> Thanks,
>
> Satyan
>
>
>
>
>
> ---- On Wed, 23 May 2018 15:01:39 +0530 Chellasamy G &
> lt;chellasamy.g@zohocorp.com> wrote ----
>
>
>
>
> Hi,
>
>
>
>
>
>
>
> Thanks for the reply.
>
>
>
>
>
>
>
> Actually I need to implement it for StringField which is non-analyzed. So,
> if I am not wrong I can't add the analyzer for StringField.
>
>
>
>
>
>
>
>
>
>
>
> My scenario is something similar to the one discussed in the below thread,
>
>
>
>
>
>
>
>
> https://discuss.elastic.co/t/es-5-0-case-insensitive-search-for-keyword-fields/64111/10
>
>
>
>
>
>
>
> Could you please let me know how to do the same the thing in lucene.
>
>
>
>
>
>
>
>
>
>
>
> Thanks,
>
>
>
> Satyan
>
>
>
>
>
>
>
>
>
>
>
>
>
> ---- On Wed, 23 May 2018 12:09:31 +0530 Adrien Grand &
> amp;lt;jpountz@gmail.com&gt; wrote ----
>
>
>
>
>
>
>
>
>
> Hi Satyan,
>
>
>
>
>
>
>
> You need to add a LowercaseTokenFilter to your analysis chain. The way to
>
>
>
> do it depends on how you are building your analyzer today (pre-built
>
>
>
> analyzer, extending Analyzer or using CustomAnalyzer). This will preserve
>
>
>
> the original case in field values because lowercasing will only be applied
>
>
>
> to the content of the inverted index, not stored fields where hits are
>
>
>
> fetched from.
>
>
>
>
>
>
>
> Le mer. 23 mai 2018 à 08:36, Chellasamy G &
> amp;lt;chellasamy.g@zohocorp.com&gt; a
>
>
>
> écrit :
>
>
>
>
>
>
>
> &gt;
>
>
>
> &gt;
>
>
>
> &gt; Hi,
>
>
>
> &gt;
>
>
>
> &gt;
>
>
>
> &gt;
>
>
>
> &gt; I can't find any way to perform case insensitive search on
> StringField.
>
>
>
> &gt; Please help me out.
>
>
>
> &gt;
>
>
>
> &gt;
>
>
>
> &gt;
>
>
>
> &gt;
>
>
>
> &gt;
>
>
>
> &gt; i.e If the field value is "Flying Robots", then the phrases
> "flying
>
>
>
> &gt; robots", "fLying RObots" etc should match the value.
>
>
>
> &gt;
>
>
>
> &gt;
>
>
>
> &gt;
>
>
>
> &gt;
>
>
>
> &gt;
>
>
>
> &gt; I also need the original case of the field value to be preserved
> in the
>
>
>
> &gt; search results.
>
>
>
> &gt;
>
>
>
> &gt;
>
>
>
> &gt;
>
>
>
> &gt;
>
>
>
> &gt;
>
>
>
> &gt; Thanks,
>
>
>
> &gt;
>
>
>
> &gt; Satyan
>
>
>
> &gt;
>
>
>
> &gt;
>
>
>
> &gt;
>
>
>
> &gt;
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
Re: Case Insensitive Search for StringField
Posted by Chellasamy G <ch...@zohocorp.com>.
Hi Team,
Kindly help me out with this problem.
Thanks,
Satyan
---- On Wed, 23 May 2018 15:01:39 +0530 Chellasamy G <chellasamy.g@zohocorp.com> wrote ----
Hi,
Thanks for the reply.
Actually I need to implement it for StringField which is non-analyzed. So, if I am not wrong I can't add the analyzer for StringField.
My scenario is something similar to the one discussed in the below thread,
https://discuss.elastic.co/t/es-5-0-case-insensitive-search-for-keyword-fields/64111/10
Could you please let me know how to do the same the thing in lucene.
Thanks,
Satyan
---- On Wed, 23 May 2018 12:09:31 +0530 Adrien Grand &lt;jpountz@gmail.com&gt; wrote ----
Hi Satyan,
You need to add a LowercaseTokenFilter to your analysis chain. The way to
do it depends on how you are building your analyzer today (pre-built
analyzer, extending Analyzer or using CustomAnalyzer). This will preserve
the original case in field values because lowercasing will only be applied
to the content of the inverted index, not stored fields where hits are
fetched from.
Le mer. 23 mai 2018 à 08:36, Chellasamy G &lt;chellasamy.g@zohocorp.com&gt; a
écrit :
&gt;
&gt;
&gt; Hi,
&gt;
&gt;
&gt;
&gt; I can't find any way to perform case insensitive search on StringField.
&gt; Please help me out.
&gt;
&gt;
&gt;
&gt;
&gt;
&gt; i.e If the field value is "Flying Robots", then the phrases "flying
&gt; robots", "fLying RObots" etc should match the value.
&gt;
&gt;
&gt;
&gt;
&gt;
&gt; I also need the original case of the field value to be preserved in the
&gt; search results.
&gt;
&gt;
&gt;
&gt;
&gt;
&gt; Thanks,
&gt;
&gt; Satyan
&gt;
&gt;
&gt;
&gt;
Re: Case Insensitive Search for StringField
Posted by Chellasamy G <ch...@zohocorp.com>.
Hi,
Thanks for the reply.
Actually I need to implement it for StringField which is non-analyzed. So, if I am not wrong I can't add the analyzer for StringField.
My scenario is something similar to the one discussed in the below thread,
https://discuss.elastic.co/t/es-5-0-case-insensitive-search-for-keyword-fields/64111/10
Could you please let me know how to do the same the thing in lucene.
Thanks,
Satyan
---- On Wed, 23 May 2018 12:09:31 +0530 Adrien Grand <jpountz@gmail.com> wrote ----
Hi Satyan,
You need to add a LowercaseTokenFilter to your analysis chain. The way to
do it depends on how you are building your analyzer today (pre-built
analyzer, extending Analyzer or using CustomAnalyzer). This will preserve
the original case in field values because lowercasing will only be applied
to the content of the inverted index, not stored fields where hits are
fetched from.
Le mer. 23 mai 2018 à 08:36, Chellasamy G <chellasamy.g@zohocorp.com> a
écrit :
>
>
> Hi,
>
>
>
> I can't find any way to perform case insensitive search on StringField.
> Please help me out.
>
>
>
>
>
> i.e If the field value is "Flying Robots", then the phrases "flying
> robots", "fLying RObots" etc should match the value.
>
>
>
>
>
> I also need the original case of the field value to be preserved in the
> search results.
>
>
>
>
>
> Thanks,
>
> Satyan
>
>
>
>
Re: Case Insensitive Search for StringField
Posted by Adrien Grand <jp...@gmail.com>.
Hi Satyan,
You need to add a LowercaseTokenFilter to your analysis chain. The way to
do it depends on how you are building your analyzer today (pre-built
analyzer, extending Analyzer or using CustomAnalyzer). This will preserve
the original case in field values because lowercasing will only be applied
to the content of the inverted index, not stored fields where hits are
fetched from.
Le mer. 23 mai 2018 à 08:36, Chellasamy G <ch...@zohocorp.com> a
écrit :
>
>
> Hi,
>
>
>
> I can't find any way to perform case insensitive search on StringField.
> Please help me out.
>
>
>
>
>
> i.e If the field value is "Flying Robots", then the phrases "flying
> robots", "fLying RObots" etc should match the value.
>
>
>
>
>
> I also need the original case of the field value to be preserved in the
> search results.
>
>
>
>
>
> Thanks,
>
> Satyan
>
>
>
>