You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@tika.apache.org by "Nick Burch (JIRA)" <ji...@apache.org> on 2012/05/18 04:06:09 UTC

[jira] [Commented] (TIKA-867) UTF-8 encoding does not work on windows

    [ https://issues.apache.org/jira/browse/TIKA-867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13278504#comment-13278504 ] 

Nick Burch commented on TIKA-867:
---------------------------------

As a general rule, you need ensure the following:
 * Tika is outputting in the encoding that your terminal is expecting to display in
 * That encoding actually supports the characters you have (mainly a problem for non-Unicode encodings)
 * The font your terminal uses has glyphs to display all the characters you have

If any of those are not the case, then things won't work properly / at all
                
> UTF-8 encoding does not work on windows
> ---------------------------------------
>
>                 Key: TIKA-867
>                 URL: https://issues.apache.org/jira/browse/TIKA-867
>             Project: Tika
>          Issue Type: Bug
>          Components: cli
>    Affects Versions: 1.0
>         Environment: Windows 7 Enterprise (Java 1.6.0_31) and MAC OS X 10.7.3 (Java 1.6.0_30)
>            Reporter: Wolfgang Außerlechner
>         Attachments: TIKA-867.patch
>
>
> When calling tika as command line tool from within java and parsing the output buffer with UTF-8 (e.g. new String(buffer, 0, len, Charset.forName("UTF-8"));) behaviour on windows is different than on mac os.
> On windows the encoding seems to be wrong (Währung vs. W?hrung). Other tools like exiftool work as expected.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira