You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@avro.apache.org by "Joel Turkel (Jira)" <ji...@apache.org> on 2020/11/20 19:12:00 UTC
[jira] [Commented] (AVRO-2984) Ruby: Unnecessary memory allocations
during serialization
[ https://issues.apache.org/jira/browse/AVRO-2984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17236384#comment-17236384 ]
Joel Turkel commented on AVRO-2984:
-----------------------------------
[https://github.com/apache/avro/pull/1014] fixes this issue.
> Ruby: Unnecessary memory allocations during serialization
> ---------------------------------------------------------
>
> Key: AVRO-2984
> URL: https://issues.apache.org/jira/browse/AVRO-2984
> Project: Apache Avro
> Issue Type: Improvement
> Components: ruby
> Affects Versions: 1.10.0
> Reporter: Joel Turkel
> Priority: Major
>
> Profiling our Ruby event publishing pipeline, we see two big sources of unnecessary memory allocations:
> # Avro::IO:DatumWriter#write_data allocates a hash of constant validation options
> # Avro::SchemaValidator::Result allocates an errors array which is unnecessary for the common case of no validation errors
> This is on a very hot codepath for us and accounts for roughly 30% of the memory allocated by this part of the event publishing pipeline.
> Github PR coming shortly.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)