You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@lucene.apache.org by Apache Wiki <wi...@apache.org> on 2013/06/24 21:19:22 UTC

[Solr Wiki] Update of "AnalyzersTokenizersTokenFilters" by ShawnHeisey

Dear Wiki user,

You have subscribed to a wiki page or wiki category on "Solr Wiki" for change notification.

The "AnalyzersTokenizersTokenFilters" page has been changed by ShawnHeisey:
https://wiki.apache.org/solr/AnalyzersTokenizersTokenFilters?action=diff&rev1=145&rev2=146

Comment:
Updated format of stopword list to what's required in the stopwords.txt file.

  
  Discards common words.
  
- The default English stop words are:
- 
- {{{
-     "a", "an", "and", "are", "as", "at", "be", "but", "by",
-     "for", "if", "in", "into", "is", "it",
-     "no", "not", "of", "on", "or", "s", "such",
-     "t", "that", "the", "their", "then", "there", "these",
-     "they", "this", "to", "was", "will", "with"
- }}}
  A customized stop word list may be specified with the "words" attribute in the schema. Optionally, the "ignoreCase" attribute may be used to ignore the case of tokens when comparing to the stopword list.
  
  {{{
@@ -369, +360 @@

     </analyzer>
  </fieldtype>
  }}}
+ 
+ The default English stop words are in the following list.  This is the format of file referenced in the "words" attribute for this filter:
+ 
+ {{{
+ #Standard english stop words taken from Lucene's StopAnalyzer
+ a
+ an
+ and
+ are
+ as
+ at
+ be
+ but
+ by
+ for
+ if
+ in
+ into
+ is
+ it
+ no
+ not
+ of
+ on
+ or
+ s
+ such
+ t
+ that
+ the
+ their
+ then
+ there
+ these
+ they
+ this
+ to
+ was
+ will
+ with
+ }}}
+ 
  <<Anchor(CommonGramsFilter)>>
  
  === solr.CommonGramsFilterFactory ===