You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@avro.apache.org by "Joel Turkel (Jira)" <ji...@apache.org> on 2020/11/20 19:02:00 UTC
[jira] [Created] (AVRO-2984) Ruby: Unnecessary memory allocations
during serialization
Joel Turkel created AVRO-2984:
---------------------------------
Summary: Ruby: Unnecessary memory allocations during serialization
Key: AVRO-2984
URL: https://issues.apache.org/jira/browse/AVRO-2984
Project: Apache Avro
Issue Type: Improvement
Components: ruby
Affects Versions: 1.10.0
Reporter: Joel Turkel
Profiling our Ruby event publishing pipeline, we see two big sources of unnecessary memory allocations:
# Avro::IO:DatumWriter#write_data allocates a hash of constant validation options
# Avro::SchemaValidator::Result allocates an errors array which is unnecessary for the common case of no validation errors
This is on a very hot codepath for us and accounts for roughly 30% of the memory allocated by this part of the event publishing pipeline.
Github PR coming shortly.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)