You are viewing a plain text version of this content. The canonical link for it is here.

Posted to solr-commits@lucene.apache.org by Apache Wiki <wi...@apache.org> on 2010/05/22 20:38:08 UTC

[Solr Wiki] Update of "AnalyzersTokenizersTokenFilters" by SaschaSzott

Dear Wiki user,

You have subscribed to a wiki page or wiki category on "Solr Wiki" for change notification.

The "AnalyzersTokenizersTokenFilters" page has been changed by SaschaSzott.
http://wiki.apache.org/solr/AnalyzersTokenizersTokenFilters?action=diff&rev1=81&rev2=82

--------------------------------------------------

  For example, the sentence "please divide this sentence into shingles" might be tokenized into shingles "please divide", "divide this", "this sentence", "sentence into", and "into shingles".
  
  
- || '''arg''' || '''value''' ||
+ || '''arg''' || '''default value''' || '''note''' ||
- || maxShingleSize || default 2 ||
+ || maxShingleSize || 2 || ||
+ || minShingleSize || 2 || <!> [[Solr1.5]] -- [[https://issues.apache.org/jira/browse/SOLR-1740|SOLR-1740]] ||
- || outputUnigrams || default true ||
+ || outputUnigrams || true || ||
+ || tokenSeparator || " " || <!> [[Solr1.5]] -- [[https://issues.apache.org/jira/browse/SOLR-1740|SOLR-1740]] ||
  
  {{{
    <filter class="solr.ShingleFilterFactory" maxShingleSize="2" outputUnigrams="true"/>