You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by "Steve Rowe (JIRA)" <ji...@apache.org> on 2014/01/10 07:01:57 UTC
[jira] [Updated] (LUCENE-5391) uax29urlemailtokenizer - unexpected
tokenisation of "index2.php" (and other inputs)
[ https://issues.apache.org/jira/browse/LUCENE-5391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Steve Rowe updated LUCENE-5391:
-------------------------------
Attachment: LUCENE-5391.patch
Patch fixing the bug, with some added tests.
Committing shortly.
> uax29urlemailtokenizer - unexpected tokenisation of "index2.php" (and other inputs)
> -----------------------------------------------------------------------------------
>
> Key: LUCENE-5391
> URL: https://issues.apache.org/jira/browse/LUCENE-5391
> Project: Lucene - Core
> Issue Type: Bug
> Reporter: Chris Geeringh
> Attachments: LUCENE-5391.patch
>
>
> The uax29urlemailtokenizer tokenises index2.php as:
> <URL> index2.ph
> <ALPHANUM> p
> While it does not do the same for index.php
> Screenshot from analyser: http://postimg.org/image/aj6c98n3b/
--
This message was sent by Atlassian JIRA
(v6.1.5#6160)
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org