You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by ad...@ukr.net on 2020/09/07 10:21:01 UTC
Fw: Inverse English an digits in Arabic Text
Hi,
Could please help to resolve an issue. I upload/index several documents in English and in Arabic languages to SOLR, in addition I use handler for Arabic language:
<fieldType name="text" class="solr.TextField" positionIncrementGap="50">
<analyzer type="index">
<tokenizer class="solr.StandardTokenizerFactory"/>
<filter class="solr.StopFilterFactory" ignoreCase="true" words="stopwords.txt" enablePositionIncrements="true" />
<filter class="solr.RemoveDuplicatesTokenFilterFactory"/>
<filter class="solr.ArabicNormalizationFilterFactory"/>
<filter class="solr.ArabicStemFilterFactory"/>
<filter class="solr.LowerCaseFilterFactory"/>
</analyzer>
<analyzer type="query">
<tokenizer class="solr.StandardTokenizerFactory"/>
<filter class="solr.StopFilterFactory" ignoreCase="true" words="stopwords.txt" enablePositionIncrements="true" />
<filter class="solr.SynonymFilterFactory" synonyms="synonyms.txt" ignoreCase="true" expand="true"/>
<filter class="solr.RemoveDuplicatesTokenFilterFactory"/>
<filter class="solr.ArabicNormalizationFilterFactory"/>
<filter class="solr.ArabicStemFilterFactory"/>
<filter class="solr.LowerCaseFilterFactory"/>
</analyzer>
There are two environments:
Local machine: - SOLR version: 4,2
- Windows version: 10
DEV env: - SOLR version 4.1 as part of the cloudera suit
- Linux core version: 3.10.0-862
Issue appears when uploading documents:
Local machine: - Doc in English with English words only - ok (for example, "www.apache.org")
- Doc in Arabic with some English words - ok (for example, "www.apache.org")
DEV env: - Doc in English with English words only - ok (for example, "www.apache.org")
- Doc in Arabic with some English - English text is inverted (for example, "gro.echapa.www"), what makes search by key words impossible.
Please advise whether this fixable and how?
Thank you in advance!