You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@pdfbox.apache.org by "Maruan Sahyoun (JIRA)" <ji...@apache.org> on 2015/10/23 18:07:27 UTC
[jira] [Issue Comment Deleted] (PDFBOX-2252) PDFTextStripper has
problem with documents with mixed language directions
[ https://issues.apache.org/jira/browse/PDFBOX-2252?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Maruan Sahyoun updated PDFBOX-2252:
-----------------------------------
Comment: was deleted
(was: From a quick scan the results for bidi text improved a lot as it now seems to correctly handle the mixed text:
govdocs1/302/302975.pdf
before: {{fo: 65 | في: 37 | من: 34 | ot: 33 | أو: 31 | غير: 30 | of: 27 | على: 22 | عمل: 18 | dna: 18}}
after: {{of: 92 | في: 47 | أو: 45 | من: 45 | to: 42 | and: 28 | على: 28 | غير: 24 | طبية: 20 | عن: 18}}
commoncrawl2/ZN/ZNWHQ7WJSR3NCQVIHEXAMKZC47LAJURT
before: {{eçkrüt: 1 | شمروتكناشواط: 1 | abak: 1 | ىنامثعناسل: 1}}
after: {{شمروتكناشواط: 1 | kaba: 1 | türkçe: 1 | ىنامثعناسل: 1}}
commoncrawl2/PA/PANWJVU76BPMA4BF2OGO74ZPRLDWGNBA
before: {{يف: 29 | the: 27 | in: 23 | and: 22 | نم: 13 | for: 12 | of: 11 | 2009: 11 | 2010: 10 | دنع: 10}}
after: {{في: 29 | the: 27 | in: 23 | and: 22 | من: 13 | for: 12 | of: 11 | 2009: 11 | at: 10 | الوالدة: 10}})
> PDFTextStripper has problem with documents with mixed language directions
> -------------------------------------------------------------------------
>
> Key: PDFBOX-2252
> URL: https://issues.apache.org/jira/browse/PDFBOX-2252
> Project: PDFBox
> Issue Type: Bug
> Components: Text extraction
> Affects Versions: 1.8.6, 2.0.0
> Reporter: Amir
> Assignee: Maruan Sahyoun
> Priority: Critical
> Fix For: 2.1.0
>
> Attachments: BidiMirroring.txt, IsMirroredDeviations.txt, PDFTextStripper-201709271718.patch, PDFTextStripper-201709272018.patch, PDFTextStripper.java.patch, PDFTextStripper.java.patch, atest.pdf, bugzilla867751.pdf, content_diffs.xlsx, overlap.jpg, pdfs_directionality.xlsx, pdfs_directionality3.xlsx, test.pdf, wikipedia_dl_lyric_test.pdf
>
>
> When the input document of PDFTextStripper is a combination of right-to-left and left-to-right languages, the output characters of one language is reversed.
> A sample bilingual pdf document is attached.
> PDFTextStripper has a variable "isRtlDominant" in "writePage" function, which is defined as follows: boolean isRtlDominant = rtlCount > ltrCount;
> This class clearly count the number of rtl characters and decide if the whole content should be revered or not. It's not true, it must operate on each word, not the whole document.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@pdfbox.apache.org
For additional commands, e-mail: dev-help@pdfbox.apache.org