You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by "Artem Lukanin (JIRA)" <ji...@apache.org> on 2013/06/11 10:22:19 UTC
[jira] [Commented] (LUCENE-5051) Incorrect abbreviation synonyms
treating in WordDelimiterFilter
[ https://issues.apache.org/jira/browse/LUCENE-5051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13680296#comment-13680296 ]
Artem Lukanin commented on LUCENE-5051:
---------------------------------------
Correct treatment:
before and after WordDelimiterFilter:
<code><pre>
tokens: wi fi wireles network
positions: 1 2 1 2
</pre></code>
Incorrect treatment:
before WordDelimiterFilter:
<code><pre>
tokens: wi.fi. wireles.network.
positions: 1 1
</pre></code>
after WordDelimiterFilter:
<code><pre>
tokens: wi fi wireles network
positions: 1 2 3 4
</pre></code>
but should be:
<code><pre>
tokens: wi fi wireles network
positions: 1 2 1 2
</pre></code>
> Incorrect abbreviation synonyms treating in WordDelimiterFilter
> ---------------------------------------------------------------
>
> Key: LUCENE-5051
> URL: https://issues.apache.org/jira/browse/LUCENE-5051
> Project: Lucene - Core
> Issue Type: Bug
> Affects Versions: 4.3, 4.3.1
> Reporter: Artem Lukanin
>
> If there are 2 abbreviation synonyms in the stream, they are not treated as synonyms after splitting by dots in WordDelimiterFilter.
> Correct treatment:
> before and after WordDelimiterFilter:
> <code><pre>
> tokens: wi fi wireles network
> positions: 1 2 1 2
> </pre></code>
> Incorrect treatment:
> before WordDelimiterFilter:
> <code><pre>
> tokens: wi.fi. wireles.network.
> positions: 1 1
> </pre></code>
> after WordDelimiterFilter:
> <code><pre>
> tokens: wi fi wireles network
> positions: 1 2 3 4
> </pre></code>
> but should be:
> <code><pre>
> tokens: wi fi wireles network
> positions: 1 2 1 2
> </pre></code>
> See a patch for Solr 4.3.1 configs, which demonstrates the bug if "wi.fi. router" is analyzed in name_syn field.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org