You are viewing a plain text version of this content. The canonical link for it is here.
Posted to solr-commits@lucene.apache.org by Apache Wiki <wi...@apache.org> on 2006/02/14 06:27:35 UTC

[Solr Wiki] Update of "AnalyzersTokenizersTokenFilters" by OtisGospodnetic

Dear Wiki user,

You have subscribed to a wiki page or wiki category on "Solr Wiki" for change notification.

The following page has been changed by OtisGospodnetic:
http://wiki.apache.org/solr/AnalyzersTokenizersTokenFilters

------------------------------------------------------------------------------
  = Analyzers, Tokenizers, and Token Filters =
  
- When a document is indexed, it's individual fields are subject to the analyzing and tokenizing filters that can transform and normalize the data in the fields. For example &#151; removing blank spaces, removing html code, stemming, removing a particular character and replacing it with another. At indexing time as well as at query time you may need to do some of the above or similiar operations. For example, you might perform a [http://en.wikipedia.org/wiki/Soundex Soundex] transformation (a type of phonic hashing) on a string to enable a search based upon the word and upon its 'sound-alikes'.  
+ When a document is indexed, its individual fields are subject to the analyzing and tokenizing filters that can transform and normalize the data in the fields. For example &#151; removing blank spaces, removing html code, stemming, removing a particular character and replacing it with another. At indexing time as well as at query time you may need to do some of the above or similiar operations. For example, you might perform a [http://en.wikipedia.org/wiki/Soundex Soundex] transformation (a type of phonic hashing) on a string to enable a search based upon the word and upon its 'sound-alikes'.  
  
  '''Note:''' 
- For a good background on Lucene Analysis, it's recommended that you read the following sections in [http://lucenebook.com/search Lucene In Action]: 
+ For a good background on Lucene Analysis, it's recommended that you read the following sections in [http://lucenebook.com/ Lucene In Action]: 
   * 1.5.3 : Analyzer
   * Chapter 4.0 through 4.7 at least