[Solr Wiki] Update of "AnalyzersTokenizersTokenFilters" by NikolaSmolenski

[Apache Wiki <wi...@apache.org>]

Dear Wiki user,

You have subscribed to a wiki page or wiki category on "Solr Wiki" for change notification.

The "AnalyzersTokenizersTokenFilters" page has been changed by NikolaSmolenski:
https://wiki.apache.org/solr/AnalyzersTokenizersTokenFilters?action=diff&rev1=157&rev2=158

Comment:
Link javadoc

   </analyzer>
  </fieldType>
  }}}
- 
- 
  == Analyzers ==
  Analyzers are components that pre-process input text at index time and/or at  search time.  It's important to use the same or similar analyzers that process text in a compatible manner at index and query time.  For example, if an indexing analyzer lowercases words, then the query analyzer should do the same to enable finding the indexed words.
  
@@ -109, +107 @@

    }
  }
  }}}
- 
  As of Solr 4.0 !BaseTokenFilterFactory has been renamed to !TokenFilterFactory and moved to the package `org.apache.lucene.analysis.util`.
  
  == When To use a CharFilter vs a TokenFilter ==
@@ -132, +129 @@

  Creates `org.apache.solr.analysis.PatternReplaceCharFilter`. Applies a regex pattern to string in char stream, replacing match occurances with the specified replacement string.
  
  Example:
+ 
  {{{
  <charFilter class="solr.PatternReplaceCharFilterFactory" pattern="([^a-z])" replacement=""/>
  }}}
- 
  === solr.HTMLStripCharFilterFactory ===
  Creates `org.apache.solr.analysis.HTMLStripCharFilter`. `HTMLStripCharFilter` strips HTML from the input stream and passes the result to either `CharFilter` or `Tokenizer`.  Like other CharFilters, it's specified using a <charFilter> tag, and must come before the <tokenizer>.  An example:
  
@@ -268, +265 @@

        </analyzer>
     </fieldType>
  }}}
- See the javadoc for details.
+ See the [[https://lucene.apache.org/core/4_1_0/analyzers-common/org/apache/lucene/analysis/pattern/PatternTokenizerFactory.html|javadoc]] for details.
  
  === solr.PathHierarchyTokenizerFactory ===
  <!> [[Solr3.1]] Outputs file path hierarchies as synonyms.
@@ -286, +283 @@

      </analyzer>
    </fieldType>
  }}}
- 
  From Solr 3.2, it also supports ''reverse'' and ''skip'' parameters.
+ 
  === solr.ICUTokenizerFactory ===
  <!> [[Solr3.1]] Uses [[http://site.icu-project.org/|ICU]]'s text bounds capabilities to tokenize text.
  
@@ -351, +348 @@

        </analyzer>
      </fieldType>
  }}}
- 
  where the email_type.txt file contains just <EMAIL>.  useWhiteList defaults to false, operates as a blacklist.
- 
  
  <<Anchor(TrimFilter)>>
  
@@ -378, +373 @@

  A token filter for truncating the terms into a specific length.
  
  {{{
- <filter class="solr.TruncateTokenFilterFactory" prefixLength="5"/>    
+ <filter class="solr.TruncateTokenFilterFactory" prefixLength="5"/>
  }}}
- 
   . Example: `"abcdefg", "1234567" ==> "abcde", "12345"`.
  
  <<Anchor(PatternCaptureGroupFilter)>>
@@ -400, +394 @@

       </analyzer>
     </fieldType>
  }}}
- 
  If none of the patterns match, or if preserve_original is true, the original token will also be emitted.
- 
  
  === solr.PatternReplaceFilterFactory ===
  Like the !PatternReplaceCharFilterFactory, but operates post-tokenization. See "When to use a Char Filter vs. a Token Filter" above.
@@ -424, +416 @@

     </analyzer>
  </fieldtype>
  }}}
- 
  The default English stop words are in the following list.  This is the format of file referenced in the "words" attribute for this filter:
  
  {{{
@@ -465, +456 @@

  will
  with
  }}}
- 
  <<Anchor(CommonGramsFilter)>>
  
  === solr.CommonGramsFilterFactory ===
@@ -719, +709 @@

  === solr.ISOLatin1AccentFilterFactory ===
  Creates `org.apache.lucene.analysis.ISOLatin1AccentFilter`.
  
- Replaces accented characters in the ISO Latin 1 character set (ISO-8859-1) by their unaccented equivalent. In Solr 3.x, this filter is deprecated.  This filter does not exist at all in 4.x versions.  Use [[AnalyzersTokenizersTokenFilters#solr.ASCIIFoldingFilterFactory|ASCIIFoldingFilterFactory]] instead.
+ Replaces accented characters in the ISO Latin 1 character set (ISO-8859-1) by their unaccented equivalent. In Solr 3.x, this filter is deprecated.  This filter does not exist at all in 4.x versions.  Use [[#solr.ASCIIFoldingFilterFactory|ASCIIFoldingFilterFactory]] instead.
  
  <<Anchor(ASCIIFoldingFilterFactory)>>
  
@@ -755, +745 @@

  <<Anchor(BeiderMorseFilterFactory)>>
  
  === solr.DoubleMetaphoneFilterFactor ===
- 
  Creates `org.apache.solr.analysis.DoubleMetaphoneFilter`.
  
  The advantage over PhoneticFilter is that this supports secondary Metaphone tokens.
@@ -763, +752 @@

  {{{
    <filter class="solr.DoubleMetaphoneFilterFactory" inject="true" maxCodeLength="4"/>
  }}}
- 
  === solr.BeiderMorseFilterFactory ===
  <!> [[https://wiki.apache.org/solr/Solr3.6|Solr3.6]]