You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@avro.apache.org by "Joel Turkel (Jira)" <ji...@apache.org> on 2020/11/20 19:02:00 UTC

[jira] [Created] (AVRO-2984) Ruby: Unnecessary memory allocations during serialization

Joel Turkel created AVRO-2984:
---------------------------------

             Summary: Ruby: Unnecessary memory allocations during serialization
                 Key: AVRO-2984
                 URL: https://issues.apache.org/jira/browse/AVRO-2984
             Project: Apache Avro
          Issue Type: Improvement
          Components: ruby
    Affects Versions: 1.10.0
            Reporter: Joel Turkel


Profiling our Ruby event publishing pipeline, we see two big sources of unnecessary memory allocations:
 # Avro::IO:DatumWriter#write_data allocates a hash of constant validation options
 # Avro::SchemaValidator::Result allocates an errors array which is unnecessary for the common case of no validation errors

This is on a very hot codepath for us and accounts for roughly 30% of the memory allocated by this part of the event publishing pipeline.

Github PR coming shortly.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)