You are viewing a plain text version of this content. The canonical link for it is here.
Posted to fop-dev@xmlgraphics.apache.org by bu...@apache.org on 2009/07/30 21:58:55 UTC
DO NOT REPLY [Bug 47610] New: New hyphenation patterns
https://issues.apache.org/bugzilla/show_bug.cgi?id=47610
Summary: New hyphenation patterns
Product: Fop
Version: all
Platform: All
OS/Version: All
Status: NEW
Severity: normal
Priority: P2
Component: general
AssignedTo: fop-dev@xmlgraphics.apache.org
ReportedBy: spepping@apache.org
Created an attachment (id=24069)
--> (https://issues.apache.org/bugzilla/attachment.cgi?id=24069)
classes for hyphenation, generated from UnicodeData.txt
The TeX people are now moving to Unicode based TeX engines. Therefore they
created new hyphenation pattern files in utf-8 encoding, see
http://www.ctan.org/tex-archive/language/hyph-utf8/tex/generic/hyph-utf8/patterns/
and
http://tug.org/svn/texhyphen/trunk/hyph-utf8/tex/generic/hyph-utf8/patterns/.
These pattern files can be directly transformed into XML format and used in
FOP. I tested a few, and had no problems.
They lack one thing, however, classes. FOP uses classes to determine what is a
letter (only words consisting of letters will be hyphenated) and the LC/UC
mapping. TeX gets the classes from its Unicode setup, see e.g.
http://scripts.sil.org/svn-public/xetex/TRUNK/texmf/tex/generic/xetex/unicode-letters.tex.
I have tried to do the same, and I attach the result. These classes would be
valid for each hyphenation pattern file. Some localizations seem to have their
own variants of the LC/UC mapping, but I have not investigated that.
The classes were generated as follows: Roughly, each character that is its own
LC generates a class. Its UC and TC (title case character) are added to the
class. More precisely, the selection of characters generating a class was done
as follows:
1. In the first plane,
2. Category Ll or Lu or Lt and its own LC character, or category Lo,
3. Not in the following blocks: Superscripts and Subscripts, Letterlike
Symbols, Alphabetic Presentation Forms, Halfwidth and Fullwidth Forms, CJK
Unified Ideographs, CJK Unified Ideographs Extension A, Hangul Syllables.
We can do two things: Add these classes to each hyphenation file, or add them
to the code that generates the hyphenation trie, preferably to be read from a
separate file. I prefer the latter option. What do you think?
--
Configure bugmail: https://issues.apache.org/bugzilla/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are the assignee for the bug.
DO NOT REPLY [Bug 47610] New hyphenation patterns
Posted by bu...@apache.org.
https://issues.apache.org/bugzilla/show_bug.cgi?id=47610
Simon Pepping <sp...@apache.org> changed:
What |Removed |Added
----------------------------------------------------------------------------
Status|NEW |RESOLVED
Resolution| |FIXED
--- Comment #3 from Simon Pepping <sp...@apache.org> 2010-05-25 05:26:21 EDT ---
Fixed in revision 805561 and some later revisions, finally in revision 810896
--
Configure bugmail: https://issues.apache.org/bugzilla/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are the assignee for the bug.
DO NOT REPLY [Bug 47610] New hyphenation patterns
Posted by bu...@apache.org.
https://issues.apache.org/bugzilla/show_bug.cgi?id=47610
Glenn Adams <gl...@skynav.com> changed:
What |Removed |Added
----------------------------------------------------------------------------
Status|RESOLVED |CLOSED
--- Comment #4 from Glenn Adams <gl...@skynav.com> 2012-04-01 07:02:12 UTC ---
batch transition pre-FOP1.0 resolved+fixed bugs to closed+fixed
--
Configure bugmail: https://issues.apache.org/bugzilla/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are the assignee for the bug.
DO NOT REPLY [Bug 47610] New hyphenation patterns
Posted by bu...@apache.org.
https://issues.apache.org/bugzilla/show_bug.cgi?id=47610
--- Comment #2 from Vincent Hennebert <vh...@gmail.com> 2009-08-06 02:45:16 PDT ---
Hi Simon,
(In reply to comment #0)
> Created an attachment (id=24069) [details]
> classes for hyphenation, generated from UnicodeData.txt
<snip/>
> We can do two things: Add these classes to each hyphenation file, or add them
> to the code that generates the hyphenation trie, preferably to be read from a
> separate file. I prefer the latter option. What do you think?
Not that I know much about hyphenation, but the latter option also looks
preferable to me. I'd say that the classes belong in FOP.
Vincent
--
Configure bugmail: https://issues.apache.org/bugzilla/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are the assignee for the bug.
DO NOT REPLY [Bug 47610] New hyphenation patterns
Posted by bu...@apache.org.
https://issues.apache.org/bugzilla/show_bug.cgi?id=47610
--- Comment #1 from Simon Pepping <sp...@apache.org> 2009-07-31 12:29:53 PST ---
Of course, I can also XInclude the classes into the pattern files. The question
is if the classes are more a property of FOP or of the hyphenation pattern
files.
--
Configure bugmail: https://issues.apache.org/bugzilla/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are the assignee for the bug.