You are viewing a plain text version of this content. The canonical link for it is here.
Posted to solr-user@lucene.apache.org by ienjreny <is...@gmail.com> on 2014/05/10 14:28:16 UTC

LetterTokenizerFactory doesn't work as expected

Dears:I am applying  LetterTokenizerFactory as it is mentioned at the
following
linkhttp://wiki.apache.org/solr/AnalyzersTokenizersTokenFilters#solr.LetterTokenizerFactoryBut
when I am using the analyzer on "I can't" the results are:LCF text i
can'tBut in the documentation is mentioned to be "i", "can", "t"Is it by
mistake or there something wrong with my schema code                      



--
View this message in context: http://lucene.472066.n3.nabble.com/LetterTokenizerFactory-doesn-t-work-as-expected-tp4135082.html
Sent from the Solr - User mailing list archive at Nabble.com.

Re: LetterTokenizerFactory doesn't work as expected

Posted by Jack Krupansky <ja...@basetechnology.com>.
Please post your full field type analyzer. The letter tokenizer should in 
fact return "I", "can", and "t" - if it is used properly.

-- Jack Krupansky

-----Original Message----- 
From: ienjreny
Sent: Saturday, May 10, 2014 8:28 AM
To: solr-user@lucene.apache.org
Subject: LetterTokenizerFactory doesn't work as expected

Dears:I am applying  LetterTokenizerFactory as it is mentioned at the
following
linkhttp://wiki.apache.org/solr/AnalyzersTokenizersTokenFilters#solr.LetterTokenizerFactoryBut
when I am using the analyzer on "I can't" the results are:LCF text i
can'tBut in the documentation is mentioned to be "i", "can", "t"Is it by
mistake or there something wrong with my schema code



--
View this message in context: 
http://lucene.472066.n3.nabble.com/LetterTokenizerFactory-doesn-t-work-as-expected-tp4135082.html
Sent from the Solr - User mailing list archive at Nabble.com. 


Re: LetterTokenizerFactory doesn't work as expected

Posted by Ismaeel Enjreny <is...@gmail.com>.
I got the error based on your feedback

I am using <tokenizer class="solr.LetterTokenizerFactory"/> inside <field>
instead of <fieldType>, I did the changes and it is working fine

Thanks for your support


On Sun, May 11, 2014 at 3:50 PM, Ahmet Arslan <io...@yahoo.com> wrote:

> Hi,
>
> Are you really using letter tokenizer? You should see LT as abbreviation
> in analysis page.
>
>       <fieldType name="letter" class="solr.TextField"
> positionIncrementGap="100">
>          <analyzer>
>           <tokenizer class="solr.LetterTokenizerFactory"/>
>          </analyzer>
>       </fieldType>
>
> Ahmet
>
>
>
>
>
> On Sunday, May 11, 2014 12:42 PM, ienjreny <is...@gmail.com>
> wrote:
> Dears:I am applying  LetterTokenizerFactory as it is mentioned at the
> following
> linkhttp://
> wiki.apache.org/solr/AnalyzersTokenizersTokenFilters#solr.LetterTokenizerFactoryBut
> when I am using the analyzer on "I can't" the results are:LCF text i
> can'tBut in the documentation is mentioned to be "i", "can", "t"Is it by
> mistake or there something wrong with my schema code
>
>
>
> --
> View this message in context:
> http://lucene.472066.n3.nabble.com/LetterTokenizerFactory-doesn-t-work-as-expected-tp4135082.html
> Sent from the Solr - User mailing list archive at Nabble.com.
>

Re: LetterTokenizerFactory doesn't work as expected

Posted by Ahmet Arslan <io...@yahoo.com>.
Hi,

Are you really using letter tokenizer? You should see LT as abbreviation in analysis page.

      <fieldType name="letter" class="solr.TextField" positionIncrementGap="100">
         <analyzer>
          <tokenizer class="solr.LetterTokenizerFactory"/>
         </analyzer>
      </fieldType>

Ahmet





On Sunday, May 11, 2014 12:42 PM, ienjreny <is...@gmail.com> wrote:
Dears:I am applying  LetterTokenizerFactory as it is mentioned at the
following
linkhttp://wiki.apache.org/solr/AnalyzersTokenizersTokenFilters#solr.LetterTokenizerFactoryBut
when I am using the analyzer on "I can't" the results are:LCF text i
can'tBut in the documentation is mentioned to be "i", "can", "t"Is it by
mistake or there something wrong with my schema code                      



--
View this message in context: http://lucene.472066.n3.nabble.com/LetterTokenizerFactory-doesn-t-work-as-expected-tp4135082.html
Sent from the Solr - User mailing list archive at Nabble.com.