You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Georg Heiler (Jira)" <ji...@apache.org> on 2020/07/10 05:03:00 UTC
[jira] [Commented] (FLINK-18478) AvroDeserializationSchema does not
work with types generated by avrohugger
[ https://issues.apache.org/jira/browse/FLINK-18478?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17155125#comment-17155125 ]
Georg Heiler commented on FLINK-18478:
--------------------------------------
I have created a fresh local build of flink to test it. I can confirm that the initial issue is solved! However, it still fails with a similar issue:
{{{color:#000000}org.apache.avro.{color}{color:#008080}AvroRuntimeException{color}{color:#000000}: {color}{color:#0000ff}Not{color}{color:#000000} a {color}{color:#008080}Specific{color} {color:#0000ff}class{color}{color:#000000}: {color}{color:#0000ff}class{color}{color:#000000} $line12.$read$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$Tweet{color}}}
{color:#000000}I have created a reproducible example here https://gist.github.com/geoHeil/5a5a4ae0ca2a8049617afa91acf40f89{color}
> AvroDeserializationSchema does not work with types generated by avrohugger
> --------------------------------------------------------------------------
>
> Key: FLINK-18478
> URL: https://issues.apache.org/jira/browse/FLINK-18478
> Project: Flink
> Issue Type: Bug
> Components: Formats (JSON, Avro, Parquet, ORC, SequenceFile)
> Reporter: Aljoscha Krettek
> Assignee: Aljoscha Krettek
> Priority: Major
> Labels: pull-request-available
> Fix For: 1.10.2, 1.12.0, 1.11.1
>
>
> The main problem is that the code in {{SpecificData.createSchema()}} tries to reflectively read the {{SCHEMA$}} field, that is normally there in Avro generated classes. However, avrohugger generates this field in a companion object, which the reflective Java code will therefore not find.
> This is also described in these ML threads:
> * [https://lists.apache.org/thread.html/5db58c7d15e4e9aaa515f935be3b342fe036e97d32e1fb0f0d1797ee@%3Cuser.flink.apache.org%3E]
> * [https://lists.apache.org/thread.html/cf1c5b8fa7f095739438807de9f2497e04ffe55237c5dea83355112d@%3Cuser.flink.apache.org%3E]
--
This message was sent by Atlassian Jira
(v8.3.4#803005)