You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@lucene.apache.org by da...@apache.org on 2018/09/20 23:59:26 UTC
[20/29] lucene-solr:jira/http2: SOLR-12784: Fix broken link to
stemdict.txt by including it in the Guide directly
SOLR-12784: Fix broken link to stemdict.txt by including it in the Guide directly
Project: http://git-wip-us.apache.org/repos/asf/lucene-solr/repo
Commit: http://git-wip-us.apache.org/repos/asf/lucene-solr/commit/264110e7
Tree: http://git-wip-us.apache.org/repos/asf/lucene-solr/tree/264110e7
Diff: http://git-wip-us.apache.org/repos/asf/lucene-solr/diff/264110e7
Branch: refs/heads/jira/http2
Commit: 264110e7b92fdca471db593390901c632cb83bcb
Parents: 5981895
Author: Cassandra Targett <ct...@apache.org>
Authored: Wed Sep 19 14:15:01 2018 -0500
Committer: Cassandra Targett <ct...@apache.org>
Committed: Wed Sep 19 14:15:01 2018 -0500
----------------------------------------------------------------------
solr/solr-ref-guide/src/language-analysis.adoc | 13 +++++++++++--
1 file changed, 11 insertions(+), 2 deletions(-)
----------------------------------------------------------------------
http://git-wip-us.apache.org/repos/asf/lucene-solr/blob/264110e7/solr/solr-ref-guide/src/language-analysis.adoc
----------------------------------------------------------------------
diff --git a/solr/solr-ref-guide/src/language-analysis.adoc b/solr/solr-ref-guide/src/language-analysis.adoc
index 2749ce1..d31d295 100644
--- a/solr/solr-ref-guide/src/language-analysis.adoc
+++ b/solr/solr-ref-guide/src/language-analysis.adoc
@@ -1,4 +1,5 @@
= Language Analysis
+:example-source-dir: {solr-root-path}core/src/test-files/solr/collection1/conf/
// Licensed to the Apache Software Foundation (ASF) under one
// or more contributor license agreements. See the NOTICE file
// distributed with this work for additional information
@@ -69,9 +70,8 @@ IMPORTANT: When adding the same token twice, it will also score twice (double),
Overrides stemming algorithms by applying a custom mapping, then protecting these terms from being modified by stemmers.
-A customized mapping of words to stems, in a tab-separated file, can be specified to the "dictionary" attribute in the schema. Words in this mapping will be stemmed to the stems from the file, and will not be further changed by any stemmer.
+A customized mapping of words to stems, in a tab-separated file, can be specified to the `dictionary` attribute in the schema. Words in this mapping will be stemmed to the stems from the file, and will not be further changed by any stemmer.
-A sample http://svn.apache.org/repos/asf/lucene/dev/trunk/solr/core/src/test-files/solr/collection1/conf/stemdict.txt[stemdict.txt] with comments can be found in the Source Repository.
[source,xml]
----
@@ -84,6 +84,15 @@ A sample http://svn.apache.org/repos/asf/lucene/dev/trunk/solr/core/src/test-fil
</fieldtype>
----
+A sample `stemdict.txt` file is shown below:
+
+[source,text]
+----
+include::{example-source-dir}stemdict.txt[lines=18..22]
+----
+
+If you have a checkout of Solr's source code locally, you can also find this example in Solr's test resources at `solr/core/src/test-files/solr/collection1/conf/stemdict.txt`.
+
== Dictionary Compound Word Token Filter
This filter splits, or _decompounds_, compound words into individual words using a dictionary of the component words. Each input token is passed through unchanged. If it can also be decompounded into subwords, each subword is also added to the stream at the same logical position.