[jira] [Resolved] (LUCENE-9283) DelimitedBoostTokenFilter can fail testRandomChains

["Alan Woodward (Jira)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/LUCENE-9283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Alan Woodward resolved LUCENE-9283.
-----------------------------------
    Fix Version/s: 8.6
                   master (9.0)
       Resolution: Fixed

> DelimitedBoostTokenFilter can fail testRandomChains
> ---------------------------------------------------
>
>                 Key: LUCENE-9283
>                 URL: https://issues.apache.org/jira/browse/LUCENE-9283
>             Project: Lucene - Core
>          Issue Type: Bug
>            Reporter: Alan Woodward
>            Assignee: Alan Woodward
>            Priority: Major
>             Fix For: master (9.0), 8.6
>
>
> DelimitedBoostTokenFilter expects tokens of the form `token` or `token|number` and throws a NumberFormatException if the `number` part can't be parsed.  This can cause test failures when we build random chains and throw random data through them.
> We can either exclude DelimiteBoostTokenFilter when building a random analyzer, or add a flag to ignore badly-formed tokens. I lean towards doing the former, as I don't really want to make leniency the default here.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@lucene.apache.org
For additional commands, e-mail: issues-help@lucene.apache.org