You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@lucene.apache.org by "Seungtack Baek (Confluence)" <co...@apache.org> on 2013/12/02 20:30:00 UTC

[CONF] Apache Solr Reference Guide > Tokenizers

Space: Apache Solr Reference Guide (https://cwiki.apache.org/confluence/display/solr)
Page: Tokenizers (https://cwiki.apache.org/confluence/display/solr/Tokenizers)
Comment: https://cwiki.apache.org/confluence/display/solr/Tokenizers?focusedCommentId=34842692#comment-34842692

Comment added by Seungtack Baek:
---------------------------------------------------------------------

On StandardTokenizer, it says

 "email address will *NOT* be preserved."

But in the example, the email address john.doe@foo.com *IS* preserved.
>From explanation, I expected john.doe@foo.com to be splitted into two tokens, "john.doe" and "foo.com"

Is this a typo?



Stop watching space: https://cwiki.apache.org/confluence/users/removespacenotification.action?spaceKey=solr
Change email notification preferences: https://cwiki.apache.org/confluence/users/editmyemailsettings.action