You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@avro.apache.org by "Ryan Skraba (Jira)" <ji...@apache.org> on 2021/03/03 09:41:00 UTC

[jira] [Updated] (AVRO-2984) Ruby: Unnecessary memory allocations during serialization

     [ https://issues.apache.org/jira/browse/AVRO-2984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Ryan Skraba updated AVRO-2984:
------------------------------
    Fix Version/s: 1.10.2

> Ruby: Unnecessary memory allocations during serialization
> ---------------------------------------------------------
>
>                 Key: AVRO-2984
>                 URL: https://issues.apache.org/jira/browse/AVRO-2984
>             Project: Apache Avro
>          Issue Type: Improvement
>          Components: ruby
>    Affects Versions: 1.10.0
>            Reporter: Joel Turkel
>            Assignee: Joel Turkel
>            Priority: Major
>             Fix For: 1.11.0, 1.10.2
>
>
> Profiling our Ruby event publishing pipeline, we see two big sources of unnecessary memory allocations:
>  # Avro::IO:DatumWriter#write_data allocates a hash of constant validation options
>  # Avro::SchemaValidator::Result allocates an errors array which is unnecessary for the common case of no validation errors
> This is on a very hot codepath for us and accounts for roughly 30% of the memory allocated by this part of the event publishing pipeline.
> Github PR coming shortly.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)