You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by "Steven Rowe (Updated) (JIRA)" <ji...@apache.org> on 2012/03/08 01:22:58 UTC
[jira] [Updated] (LUCENE-3747) Support Unicode 6.1.0
[ https://issues.apache.org/jira/browse/LUCENE-3747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Steven Rowe updated LUCENE-3747:
--------------------------------
Description:
Now that Unicode 6.1.0 has been released, Lucene/Solr should support it.
JFlex trunk now supports Unicode 6.1.0.
Tasks include:
* Upgrade ICU4J to v49 (after it's released, on 2012-03-21, according to http://icu-project.org).
* Use {{icu}} module tools to regenerate the supplementary character additions to JFlex grammars.
* Version the JFlex grammars: copy the current implementations to {{*Impl3<X>}}; cause the versioning tokenizer wrappers to instantiate this version when the {{Version}} c-tor param is in the range 3.1 to the version in which these changes are released (excluding the range endpoints); then change the specified Unicode version in the non-versioned JFlex grammars from 6.0 to 6.1.
* Regenerate JFlex scanners, including {{StandardTokenizerImpl}}, {{UAX29URLEmailTokenizerImpl}}, and {{HTMLStripCharFilter}}.
* Using {{generateJavaUnicodeWordBreakTest.pl}}, generate and then run {{WordBreakTestUnicode_6_1_0.java}} under {{modules/analysis/common/src/test/org/apache/lucene/analysis/core/}}
was:
Now that Unicode 6.1.0 has been released, Lucene/Solr should support it.
JFlex trunk now supports Unicode 6.1.0.
Tasks include:
* Upgrade ICU4J to v49 (after it's released, on 2012-03-21, according to http://icu-project.org).
* Use {{icu}} module tools to regenerate the supplementary character additions to JFlex grammars.
* Version the JFlex grammars: copy the current implementations to {{*Impl3<X>}}; cause the versioning tokenizer wrappers to instantiate this version when the {{Version}} c-tor param is in the range 3.1 to the version in which these changes are released (excluding the range endpoints); then change the specified Unicode version in the non-versioned JFlex grammars from 6.0 to 6.1.
* Regenerate JFlex scanners, including {{StandardTokenizerImpl}}, {{UAX29URLEmailTokenizerImpl}}, and {{HTMLStripCharFilter}}.
> Support Unicode 6.1.0
> ---------------------
>
> Key: LUCENE-3747
> URL: https://issues.apache.org/jira/browse/LUCENE-3747
> Project: Lucene - Java
> Issue Type: Improvement
> Components: modules/analysis
> Affects Versions: 3.5, 4.0
> Reporter: Steven Rowe
> Priority: Minor
>
> Now that Unicode 6.1.0 has been released, Lucene/Solr should support it.
> JFlex trunk now supports Unicode 6.1.0.
> Tasks include:
> * Upgrade ICU4J to v49 (after it's released, on 2012-03-21, according to http://icu-project.org).
> * Use {{icu}} module tools to regenerate the supplementary character additions to JFlex grammars.
> * Version the JFlex grammars: copy the current implementations to {{*Impl3<X>}}; cause the versioning tokenizer wrappers to instantiate this version when the {{Version}} c-tor param is in the range 3.1 to the version in which these changes are released (excluding the range endpoints); then change the specified Unicode version in the non-versioned JFlex grammars from 6.0 to 6.1.
> * Regenerate JFlex scanners, including {{StandardTokenizerImpl}}, {{UAX29URLEmailTokenizerImpl}}, and {{HTMLStripCharFilter}}.
> * Using {{generateJavaUnicodeWordBreakTest.pl}}, generate and then run {{WordBreakTestUnicode_6_1_0.java}} under {{modules/analysis/common/src/test/org/apache/lucene/analysis/core/}}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org