You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@avro.apache.org by Hinko Kocevar <Hi...@ess.eu> on 2021/11/15 16:20:46 UTC

Large vectors in C

I'm using avro C to serialize vectors of 100k elements (double, long,..) for example. Currently I'm doing this in a loop that goes over a vector `v` of doubles:

                    avro_value_append(&value_value, &element, &new_index);
                    avro_value_set_double(&element, *(v + i));

Performance is poor, terrible in fact. Is there anyway to speed this up? Is there any other approach?

Cheers,
Hinko