You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by "David Bowen (JIRA)" <ji...@apache.org> on 2010/08/31 01:56:54 UTC
[jira] Created: (LUCENE-2629) In modules/analysys/icu, ant gennorm2
does not work
In modules/analysys/icu, ant gennorm2 does not work
---------------------------------------------------
Key: LUCENE-2629
URL: https://issues.apache.org/jira/browse/LUCENE-2629
Project: Lucene - Java
Issue Type: Bug
Components: Analysis
Reporter: David Bowen
Command to run gennorm2 does not work at present. Also, icupkg needs to be called to convert the binary file to big-endian.
I will attach a patch.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
[jira] Commented: (LUCENE-2629) In modules/analysys/icu, ant
gennorm2 does not work
Posted by "Robert Muir (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/LUCENE-2629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12904441#action_12904441 ]
Robert Muir commented on LUCENE-2629:
-------------------------------------
perfect, now the file can be easily regenerated... i just tested.
(i noticed for whatever strange reason the <delete> didnt delete the utr30.tmp, but i'll figure it out)
Thanks a lot!
> In modules/analysys/icu, ant gennorm2 does not work
> ---------------------------------------------------
>
> Key: LUCENE-2629
> URL: https://issues.apache.org/jira/browse/LUCENE-2629
> Project: Lucene - Java
> Issue Type: Bug
> Components: Analysis
> Reporter: David Bowen
> Assignee: Robert Muir
> Attachments: gennorm2.patch
>
>
> Command to run gennorm2 does not work at present. Also, icupkg needs to be called to convert the binary file to big-endian.
> I will attach a patch.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
[jira] Resolved: (LUCENE-2629) In modules/analysys/icu, ant
gennorm2 does not work
Posted by "Robert Muir (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/LUCENE-2629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Robert Muir resolved LUCENE-2629.
---------------------------------
Fix Version/s: 3.1
4.0
Resolution: Fixed
Committed revision 991053 (trunk) 991055 (3x)
Thanks David!
> In modules/analysys/icu, ant gennorm2 does not work
> ---------------------------------------------------
>
> Key: LUCENE-2629
> URL: https://issues.apache.org/jira/browse/LUCENE-2629
> Project: Lucene - Java
> Issue Type: Bug
> Components: Analysis
> Reporter: David Bowen
> Assignee: Robert Muir
> Fix For: 3.1, 4.0
>
> Attachments: gennorm2.patch, gennorm2.patch, LUCENE-2629.patch
>
>
> Command to run gennorm2 does not work at present. Also, icupkg needs to be called to convert the binary file to big-endian.
> I will attach a patch.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
[jira] Commented: (LUCENE-2629) In modules/analysys/icu, ant
gennorm2 does not work
Posted by "David Bowen (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/LUCENE-2629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12904469#action_12904469 ]
David Bowen commented on LUCENE-2629:
-------------------------------------
And by the way, I tested that it is OK to run icupkg on the file even if it is already big-endian.
I find it a strange concept to have two binary file formats, one for big-endian and one for little-endian, only one of which is usable. I would have thought that the gennorm2 program should generate the file format that works, no matter what machine it is run on.
No doubt there are complex reasons for this design weirdness. I know that sadly, some people have to still deal with EBCDIC.
> In modules/analysys/icu, ant gennorm2 does not work
> ---------------------------------------------------
>
> Key: LUCENE-2629
> URL: https://issues.apache.org/jira/browse/LUCENE-2629
> Project: Lucene - Java
> Issue Type: Bug
> Components: Analysis
> Reporter: David Bowen
> Assignee: Robert Muir
> Attachments: gennorm2.patch, gennorm2.patch
>
>
> Command to run gennorm2 does not work at present. Also, icupkg needs to be called to convert the binary file to big-endian.
> I will attach a patch.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
[jira] Updated: (LUCENE-2629) In modules/analysys/icu, ant gennorm2
does not work
Posted by "Robert Muir (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/LUCENE-2629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Robert Muir updated LUCENE-2629:
--------------------------------
Attachment: LUCENE-2629.patch
Thanks David, that did the trick!
I made one small change: just in case something goes wrong it uses ${build.dir} for the temp file.
I'd like to commit this soon to trunk and 3x.
> In modules/analysys/icu, ant gennorm2 does not work
> ---------------------------------------------------
>
> Key: LUCENE-2629
> URL: https://issues.apache.org/jira/browse/LUCENE-2629
> Project: Lucene - Java
> Issue Type: Bug
> Components: Analysis
> Reporter: David Bowen
> Assignee: Robert Muir
> Attachments: gennorm2.patch, gennorm2.patch, LUCENE-2629.patch
>
>
> Command to run gennorm2 does not work at present. Also, icupkg needs to be called to convert the binary file to big-endian.
> I will attach a patch.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
[jira] Updated: (LUCENE-2629) In modules/analysys/icu, ant gennorm2
does not work
Posted by "David Bowen (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/LUCENE-2629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
David Bowen updated LUCENE-2629:
--------------------------------
Attachment: gennorm2.patch
Oops, I just noticed also that the tmpfile was not getting deleted. A stupid typo (${gennorm.tmp} instead of ${gennorm2.tmp}). Here's a fixed patch.
> In modules/analysys/icu, ant gennorm2 does not work
> ---------------------------------------------------
>
> Key: LUCENE-2629
> URL: https://issues.apache.org/jira/browse/LUCENE-2629
> Project: Lucene - Java
> Issue Type: Bug
> Components: Analysis
> Reporter: David Bowen
> Assignee: Robert Muir
> Attachments: gennorm2.patch, gennorm2.patch
>
>
> Command to run gennorm2 does not work at present. Also, icupkg needs to be called to convert the binary file to big-endian.
> I will attach a patch.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
[jira] Assigned: (LUCENE-2629) In modules/analysys/icu, ant
gennorm2 does not work
Posted by "Robert Muir (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/LUCENE-2629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Robert Muir reassigned LUCENE-2629:
-----------------------------------
Assignee: Robert Muir
> In modules/analysys/icu, ant gennorm2 does not work
> ---------------------------------------------------
>
> Key: LUCENE-2629
> URL: https://issues.apache.org/jira/browse/LUCENE-2629
> Project: Lucene - Java
> Issue Type: Bug
> Components: Analysis
> Reporter: David Bowen
> Assignee: Robert Muir
> Attachments: gennorm2.patch
>
>
> Command to run gennorm2 does not work at present. Also, icupkg needs to be called to convert the binary file to big-endian.
> I will attach a patch.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
[jira] Updated: (LUCENE-2629) In modules/analysys/icu, ant gennorm2
does not work
Posted by "David Bowen (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/LUCENE-2629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
David Bowen updated LUCENE-2629:
--------------------------------
Attachment: gennorm2.patch
Just a build.xml tweak.
I included a couple of extra tests for the ICUFoldingFilter, on the basis that more tests can't hurt.
> In modules/analysys/icu, ant gennorm2 does not work
> ---------------------------------------------------
>
> Key: LUCENE-2629
> URL: https://issues.apache.org/jira/browse/LUCENE-2629
> Project: Lucene - Java
> Issue Type: Bug
> Components: Analysis
> Reporter: David Bowen
> Attachments: gennorm2.patch
>
>
> Command to run gennorm2 does not work at present. Also, icupkg needs to be called to convert the binary file to big-endian.
> I will attach a patch.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
[jira] Commented: (LUCENE-2629) In modules/analysys/icu, ant
gennorm2 does not work
Posted by "Robert Muir (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/LUCENE-2629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12904473#action_12904473 ]
Robert Muir commented on LUCENE-2629:
-------------------------------------
bq. I find it a strange concept to have two binary file formats, one for big-endian and one for little-endian, only one of which is usable. I would have thought that the gennorm2 program should generate the file format that works, no matter what machine it is run on.
I could be wrong, but I think the reason ICU's data files are endian-dependent is because they are designed to be very very quickly mapped into memory
(e.g. the speed at which the underlying character property data can be mapped into memory so that java.lang.Character becomes useful is sensitive)
> In modules/analysys/icu, ant gennorm2 does not work
> ---------------------------------------------------
>
> Key: LUCENE-2629
> URL: https://issues.apache.org/jira/browse/LUCENE-2629
> Project: Lucene - Java
> Issue Type: Bug
> Components: Analysis
> Reporter: David Bowen
> Assignee: Robert Muir
> Attachments: gennorm2.patch, gennorm2.patch, LUCENE-2629.patch
>
>
> Command to run gennorm2 does not work at present. Also, icupkg needs to be called to convert the binary file to big-endian.
> I will attach a patch.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org