[GitHub] kad3nce edited a comment on issue #7001: Which parser to use for Avro encoded messages from Divolte?

[GitBox <gi...@apache.org>]

kad3nce edited a comment on issue #7001: Which parser to use for Avro encoded messages from Divolte?
URL: https://github.com/apache/incubator-druid/issues/7001#issuecomment-460475176
 
 
   A quick update. I tweaked `InlineSchemaAvroBytesDecoder.java` hoping for more informative errors in the ingestion report and am now getting this:
   
   `Fail to decode avro message: Invalid int encoding`
   
   Some Googling led me to [this thread](https://issues.apache.org/jira/browse/AVRO-1650?focusedCommentId=14369997&page=com.atlassian.jira.plugin.system.issuetabpanels%3Acomment-tabpanel#comment-14369997):
   
   > I suspect it is an character encoding issue as the Avro bytes generated are converted to a String using the default character encoding which is probably UTF-8 and then converted back to bytes using the same character encoding. This does not preserve the original bytes in general as some byte values are not valid UTF-8. You can use the ISO-8859-1 encoding on the new String(bytes, "ISO-8859-1") and binaryString.getBytes("ISO-8859-1") or better still just use the bytes variable in the call to binaryDecoder.
   
   But I have no idea how to apply that to this issue…
   
   Any ideas?

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org
For additional commands, e-mail: commits-help@druid.apache.org