You are viewing a plain text version of this content. The canonical link for it is here.

Posted to solr-commits@lucene.apache.org by Apache Wiki <wi...@apache.org> on 2011/02/08 05:04:15 UTC

[Solr Wiki] Update of "AnalyzersTokenizersTokenFilters" by HossMan

Dear Wiki user,

You have subscribed to a wiki page or wiki category on "Solr Wiki" for change notification.

The "AnalyzersTokenizersTokenFilters" page has been changed by HossMan.
The comment on this change is: remove bad line breaks.
http://wiki.apache.org/solr/AnalyzersTokenizersTokenFilters?action=diff&rev1=108&rev2=109

--------------------------------------------------

  
  == When To use a CharFilter vs a TokenFilter ==
  
- There are several pairs of !CharFilters and !TokenFilters that have related (ie: !MappingCharFilter
-  and !ASCIIFoldingFilter) or nearly identical functionality (ie: !PatternReplaceCharFilterFactory and !PatternReplaceFilterFactory) and it may not always be obvious which is the best choice.
+ There are several pairs of !CharFilters and !TokenFilters that have related (ie: !MappingCharFilter and ASCIIFoldingFilter) or nearly identical functionality (ie: !PatternReplaceCharFilterFactory and !PatternReplaceFilterFactory) and it may not always be obvious which is the best choice.
  
  The ultimate decision depends largely on what Tokenizer you are using, and whether you need to "out smart" it by preprocessing the stream of characters.