You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@avro.apache.org by "Stu Hood (JIRA)" <ji...@apache.org> on 2011/04/22 20:21:06 UTC

[jira] [Resolved] (AVRO-679) Improved encodings for arrays

     [ https://issues.apache.org/jira/browse/AVRO-679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Stu Hood resolved AVRO-679.
---------------------------

      Resolution: Incomplete
    Hadoop Flags:   (was: [Incompatible change])

Closing this in favor of AVRO-806.

Thanks again for your optimization help Scott.

> Improved encodings for arrays
> -----------------------------
>
>                 Key: AVRO-679
>                 URL: https://issues.apache.org/jira/browse/AVRO-679
>             Project: Avro
>          Issue Type: New Feature
>          Components: spec
>            Reporter: Stu Hood
>            Priority: Minor
>
> There are better ways to encode arrays of varints [1] which are faster to decode, and more space efficient than encoding varints independently.
> Extending the idea to other types of variable length data like 'bytes' and 'string', you could encode the entries for an array block as an array of lengths, followed by contiguous byte/utf8 data.
> [1] group varint encoding: slides 57-63 of http://static.googleusercontent.com/external_content/untrusted_dlcp/research.google.com/en/us/people/jeff/WSDM09-keynote.pdf

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira