You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by "Hoss Man (JIRA)" <ji...@apache.org> on 2015/11/30 22:58:11 UTC
[jira] [Commented] (LUCENE-6914) DecimalDigitFilter skips
characters in some cases (supplemental?)
[ https://issues.apache.org/jira/browse/LUCENE-6914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15032559#comment-15032559 ]
Hoss Man commented on LUCENE-6914:
----------------------------------
failure produced by attached test patch...
{noformat}
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=TestDecimalDigitFilter -Dtests.method=testDoubleStruck -Dtests.seed=3126DECB8CE805E -Dtests.slow=true -Dtests.locale=ga -Dtests.timezone=Africa/Juba -Dtests.asserts=true -Dtests.file.encoding=ISO-8859-1
[junit4] FAILURE 0.03s | TestDecimalDigitFilter.testDoubleStruck <<<
[junit4] > Throwable #1: org.junit.ComparisonFailure: term 0 expected:<1[984]> but was:<1[𝟡8𝟜]>
[junit4] > at __randomizedtesting.SeedInfo.seed([3126DECB8CE805E:92961DD9D4C68E38]:0)
[junit4] > at org.apache.lucene.analysis.BaseTokenStreamTestCase.assertTokenStreamContents(BaseTokenStreamTestCase.java:186)
[junit4] > at org.apache.lucene.analysis.BaseTokenStreamTestCase.assertTokenStreamContents(BaseTokenStreamTestCase.java:301)
[junit4] > at org.apache.lucene.analysis.BaseTokenStreamTestCase.assertTokenStreamContents(BaseTokenStreamTestCase.java:305)
[junit4] > at org.apache.lucene.analysis.BaseTokenStreamTestCase.assertTokenStreamContents(BaseTokenStreamTestCase.java:309)
[junit4] > at org.apache.lucene.analysis.BaseTokenStreamTestCase.assertAnalyzesTo(BaseTokenStreamTestCase.java:359)
[junit4] > at org.apache.lucene.analysis.BaseTokenStreamTestCase.assertAnalyzesTo(BaseTokenStreamTestCase.java:368)
[junit4] > at org.apache.lucene.analysis.BaseTokenStreamTestCase.checkOneTerm(BaseTokenStreamTestCase.java:429)
[junit4] > at org.apache.lucene.analysis.core.TestDecimalDigitFilter.testDoubleStruck(TestDecimalDigitFilter.java:74)
[junit4] > at java.lang.Thread.run(Thread.java:745)
{noformat}
> DecimalDigitFilter skips characters in some cases (supplemental?)
> -----------------------------------------------------------------
>
> Key: LUCENE-6914
> URL: https://issues.apache.org/jira/browse/LUCENE-6914
> Project: Lucene - Core
> Issue Type: Bug
> Affects Versions: 5.4
> Reporter: Hoss Man
> Attachments: LUCENE-6914.patch
>
>
> Found this while writing up the solr ref guide for DecimalDigitFilter.
> With input like "𝟙𝟡𝟠𝟜" ("Double Struck" 1984) the filter produces "1𝟡8𝟜" (1, double struck 9, 8, double struck 4) add some non-decimal characters in between the digits (ie: "𝟙x𝟡x𝟠x𝟜") and you get the expected output ("1x9x8x4"). This doesn't affect all decimal characters though, as evident by the existing test cases.
> Perhaps this is an off by one bug in the "if the original was supplementary, shrink the string" code path?
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org