You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by "Cassandra Targett (JIRA)" <ji...@apache.org> on 2018/02/01 20:58:00 UTC
[jira] [Updated] (SOLR-11139) FreeTextSuggester exits on first
error while building suggester index
[ https://issues.apache.org/jira/browse/SOLR-11139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Cassandra Targett updated SOLR-11139:
-------------------------------------
Priority: Major (was: Blocker)
> FreeTextSuggester exits on first error while building suggester index
> ---------------------------------------------------------------------
>
> Key: SOLR-11139
> URL: https://issues.apache.org/jira/browse/SOLR-11139
> Project: Solr
> Issue Type: Bug
> Security Level: Public(Default Security Level. Issues are Public)
> Components: Suggester
> Affects Versions: 5.5.4
> Reporter: Angel Todorov
> Priority: Major
>
> If an exception is thrown below, it will exit the while loop, therefore stopping building of the suggester index. In fact, it will not build anything, because the exception is not handled in any way. This is highly unacceptable, because in an enterprise environment there will always be data that does not conform to the expected rules.
> while (true) {
> BytesRef term = termsEnum.next();
> if (term == null) {
> break;
> }
> int ngramCount = countGrams(term);
> if (ngramCount > grams) {
> throw new IllegalArgumentException("tokens must not contain separator byte; got token=" + term + " but gramCount=" + ngramCount + ", which is greater than expected max ngram size=" + grams);
> }
> if (ngramCount == 1) {
> totTokens += termsEnum.totalTermFreq();
> }
> builder.add(Util.toIntsRef(term, scratchInts), encodeWeight(termsEnum.totalTermFreq()));
> }
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org