You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by "James Dyer (JIRA)" <ji...@apache.org> on 2012/06/01 22:57:23 UTC
[jira] [Updated] (SOLR-2993) Integrate WordBreakSpellChecker with
Solr
[ https://issues.apache.org/jira/browse/SOLR-2993?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
James Dyer updated SOLR-2993:
-----------------------------
Attachment: SOLR-2993.patch
Here is a new patch that can better handle collations involving mixed required/prohibited/optional terms and also boolean operators (AND/OR/NOT).
When combining words, we do not want to combine an optional term with a prohibited one, etc. We also do not want to combine words that belong to different boolean clauses or those that were "NOT"ed to one another.
Likewise, when splitting a term into multiples, we want to ensure all the resulting terms are required if the original one was required, etc. Also, if the query contains boolean operators (AND/OR/NOT), this version ANDs the split terms together.
In the case of Boolean operators, SpellingQueryConverter can only make a guess as to the best action. It doesn't know the actual query parser used, the default "q.op" or "mm" setting, etc. All this does is make a reasonable guess as to the best way to re-write the query if corrections involved combining and/or splitting words.
See WordBreakSpellCheckerTest#testCollate and SpellingQueryConverterTest#testRequiredOrProhibitedFlags for examples of how this works.
Unless there are other issues, I plan to commit this in a few days.
> Integrate WordBreakSpellChecker with Solr
> -----------------------------------------
>
> Key: SOLR-2993
> URL: https://issues.apache.org/jira/browse/SOLR-2993
> Project: Solr
> Issue Type: Improvement
> Components: spellchecker
> Affects Versions: 4.0
> Reporter: James Dyer
> Assignee: James Dyer
> Priority: Minor
> Fix For: 4.0, 5.0
>
> Attachments: SOLR-2993.patch, SOLR-2993.patch, SOLR-2993.patch, SOLR-2993.patch
>
>
> A SpellCheckComponent enhancement, leveraging the WordBreakSpellChecker from LUCENE-3523:
> - Detect spelling errors resulting from misplaced whitespace without the use of shingle-based dictionaries.
> - Seamlessly integrate word-break suggestions with single-word spelling corrections from the existing FileBased-, IndexBased- or Direct- spell checkers.
> - Provide collation support for word-break errors including cases where the user has a mix of single-word spelling errors and word-break errors in the same query.
> - Provide shard support.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org