[jira] Commented: (LUCENE-1758) improve arabic analyzer: light8 -> light10

["Robert Muir (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/LUCENE-1758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12736124#action_12736124 ] 

Robert Muir commented on LUCENE-1758:
-------------------------------------

I am curious, could this be considered for 2.9? 

Mostly because Arabic Analyzer is unreleased (so no back compat issues): I think the combination of لل + stopwords improvement will really help.

More details are available at: http://www.mtholyoke.edu/~lballest/Pubs/arab_stem05.pdf


> improve arabic analyzer: light8 -> light10
> ------------------------------------------
>
>                 Key: LUCENE-1758
>                 URL: https://issues.apache.org/jira/browse/LUCENE-1758
>             Project: Lucene - Java
>          Issue Type: Improvement
>          Components: contrib/analyzers
>            Reporter: Robert Muir
>            Priority: Minor
>         Attachments: LUCENE-1758.patch, LUCENE-1758.txt
>
>
> Someone mentioned on the java user list that the arabic analysis was not as good as they would like.
> This patch adds the لل- prefix (light10 algorithm versus light8 algorithm).
> In the light10 paper, this improves precision from .390 to .413
> They mention this is not statistically significant, but it makes linguistic sense and at least has been shown not to hurt.
> In the future, I hope openrelevance will allow us to try some more approaches. 

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-dev-help@lucene.apache.org