You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@avro.apache.org by "Doug Cutting (JIRA)" <ji...@apache.org> on 2014/12/18 20:06:13 UTC

[jira] [Commented] (AVRO-1593) C++ json encoder assumes "C" locale and generates invalid UTF-8 sequence

    [ https://issues.apache.org/jira/browse/AVRO-1593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14252058#comment-14252058 ] 

Doug Cutting commented on AVRO-1593:
------------------------------------

This change looks reasonable to me.  Can someone more familiar with C++ please review it?  Thanks!

> C++ json encoder assumes "C" locale and generates invalid UTF-8 sequence 
> -------------------------------------------------------------------------
>
>                 Key: AVRO-1593
>                 URL: https://issues.apache.org/jira/browse/AVRO-1593
>             Project: Avro
>          Issue Type: Bug
>          Components: c++
>    Affects Versions: 1.7.7
>         Environment: windows-1252 encoding
>            Reporter: Hatem Helal
>            Priority: Critical
>             Fix For: 1.7.8
>
>
> encoding a multibyte UTF-8 code point such as:
> "\xEF\xBD\x81"
> Incorrectly becomes:
> "\xEF\xBD\U0081"
> When encoded in the service running in the windows-1252 locale.  This isn¹t a valid UTF-8 sequence so we end up with Mojibake when reading back the JSON encoded string.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)