You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@tika.apache.org by "Adrian Diemer (Jira)" <ji...@apache.org> on 2021/01/28 07:20:01 UTC
[jira] [Comment Edited] (TIKA-3282) OneNote Parser breaks non-ASCII
Characters
[ https://issues.apache.org/jira/browse/TIKA-3282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17273375#comment-17273375 ]
Adrian Diemer edited comment on TIKA-3282 at 1/28/21, 7:19 AM:
---------------------------------------------------------------
So, as far as I can tell, the same issue occurs with older OneNote formats.
I've identified lines 80, 123, and 147 in [OneNoteLegacyDumpStrings|https://github.com/apache/tika/blob/main/tika-parsers/tika-parsers-classic/tika-parsers-classic-modules/tika-parser-microsoft-module/src/main/java/org/apache/tika/parser/microsoft/onenote/OneNoteLegacyDumpStrings.java] as probable issues but I don't know how to fix it.
Sadly, I can't provide an example file for that.
was (Author: adrian.diemer):
So, as far as I cen tell, the same issue occurs with older OneNote formats.
I've identified lines 80, 123, and 147 in [OneNoteLegacyDumpStrings|https://github.com/apache/tika/blob/main/tika-parsers/tika-parsers-classic/tika-parsers-classic-modules/tika-parser-microsoft-module/src/main/java/org/apache/tika/parser/microsoft/onenote/OneNoteLegacyDumpStrings.java] as probable issues but I don't know how to fix it.
> OneNote Parser breaks non-ASCII Characters
> ------------------------------------------
>
> Key: TIKA-3282
> URL: https://issues.apache.org/jira/browse/TIKA-3282
> Project: Tika
> Issue Type: Bug
> Components: parser
> Affects Versions: 1.24, 1.25, 1.24.1
> Reporter: Adrian Diemer
> Priority: Major
>
> The OneNote parser doesn't seem to handle non-ASCII characters correctly.
> The reason for that seems to be that the characterset US_ASCII is used instead of ISO_8859_1 [here|https://github.com/apache/tika/blob/91ef4693363d31dba05de9eec1ab2d52a298c6b5/tika-parsers/tika-parsers-classic/tika-parsers-classic-modules/tika-parser-microsoft-module/src/main/java/org/apache/tika/parser/microsoft/onenote/OneNoteTreeWalker.java#L448].
--
This message was sent by Atlassian Jira
(v8.3.4#803005)