You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@avro.apache.org by "Joel Turkel (Jira)" <ji...@apache.org> on 2020/11/20 19:12:00 UTC

[jira] [Commented] (AVRO-2984) Ruby: Unnecessary memory allocations during serialization

    [ https://issues.apache.org/jira/browse/AVRO-2984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17236384#comment-17236384 ] 

Joel Turkel commented on AVRO-2984:
-----------------------------------

[https://github.com/apache/avro/pull/1014] fixes this issue.

> Ruby: Unnecessary memory allocations during serialization
> ---------------------------------------------------------
>
>                 Key: AVRO-2984
>                 URL: https://issues.apache.org/jira/browse/AVRO-2984
>             Project: Apache Avro
>          Issue Type: Improvement
>          Components: ruby
>    Affects Versions: 1.10.0
>            Reporter: Joel Turkel
>            Priority: Major
>
> Profiling our Ruby event publishing pipeline, we see two big sources of unnecessary memory allocations:
>  # Avro::IO:DatumWriter#write_data allocates a hash of constant validation options
>  # Avro::SchemaValidator::Result allocates an errors array which is unnecessary for the common case of no validation errors
> This is on a very hot codepath for us and accounts for roughly 30% of the memory allocated by this part of the event publishing pipeline.
> Github PR coming shortly.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)