You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@flink.apache.org by "Maciej Bryński (JIRA)" <ji...@apache.org> on 2018/12/05 10:04:00 UTC

[jira] [Comment Edited] (FLINK-11076) Processing for Avro generated classes is very slow

    [ https://issues.apache.org/jira/browse/FLINK-11076?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16709850#comment-16709850 ] 

Maciej Bryński edited comment on FLINK-11076 at 12/5/18 10:03 AM:
------------------------------------------------------------------

In my workload removing "extends org.apache.avro.specific.SpecificRecordBase" from Avro generated classes give 15x performance improvement.


was (Author: maver1ck):
In my workload removing "extends org.apache.avro.specific.SpecificRecordBase" from Avro generated classes give 50x performance improvement.

> Processing for Avro generated classes is very slow
> --------------------------------------------------
>
>                 Key: FLINK-11076
>                 URL: https://issues.apache.org/jira/browse/FLINK-11076
>             Project: Flink
>          Issue Type: Bug
>            Reporter: Maciej Bryński
>            Priority: Major
>
> I tested Flink processing with Avro generated Pojo classes and most of the time is spent in serialization / deserialization.
> The problem is that those classes are internally serialized with Avro serializer instead of Pojo serializer.
> https://github.com/apache/flink/blob/ddba1b69f43cbb885e178dfaafa120f1fe196a13/flink-core/src/main/java/org/apache/flink/api/java/typeutils/TypeExtractor.java#L1736



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)