You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by "Otis Gospodnetic (JIRA)" <ji...@apache.org> on 2006/07/09 16:46:30 UTC

[jira] Assigned: (LUCENE-478) CJK char list

     [ http://issues.apache.org/jira/browse/LUCENE-478?page=all ]

Otis Gospodnetic reassigned LUCENE-478:
---------------------------------------

    Assign To: Otis Gospodnetic

> CJK char list
> -------------
>
>          Key: LUCENE-478
>          URL: http://issues.apache.org/jira/browse/LUCENE-478
>      Project: Lucene - Java
>         Type: Bug

>   Components: Analysis
>     Versions: 1.4
>     Reporter: John Wang
>     Assignee: Otis Gospodnetic
>     Priority: Minor
>  Attachments: StandardTokenizer.jj.diff, StandardTokenizer.jj.diff
>
> Seems the character list in the CJK section of the StandardTokenizer.jj is not quite complete. Following is a more complete list:
> < CJK:                                          // non-alphabets
>       [
> 	   "\u1100"-"\u11ff",
>        "\u3040"-"\u30ff",
>        "\u3130"-"\u318f",
>        "\u31f0"-"\u31ff",
>        "\u3300"-"\u337f",
>        "\u3400"-"\u4dbf",
>        "\u4e00"-"\u9fff",
>        "\uac00"-"\ud7a3",
>        "\uf900"-"\ufaff",
>        "\uff65"-"\uffdc"       
>       ]
>   >

-- 
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators:
   http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see:
   http://www.atlassian.com/software/jira


---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-dev-help@lucene.apache.org