You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@avro.apache.org by "Lucas Martin-King (Updated) (JIRA)" <ji...@apache.org> on 2011/11/21 07:56:51 UTC
[jira] [Updated] (AVRO-957) Added Codec Support to Avro-C
[ https://issues.apache.org/jira/browse/AVRO-957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Lucas Martin-King updated AVRO-957:
-----------------------------------
Description:
We (Experian Hitwise) have added codec support to avro-c (as per the avro spec), with preliminary deflate/inflate support (as well as null codec support).
This changes the way blocks are written to the file, with the block data being passed through the codec interface, before being written to file.
This also changes the way blocks are read from a file, with the block data first being read into a buffer, before being passed through the codec interface, then a memory reader is set to the decoded data, which is read by the user calls avro_file_reader_read_value() and avro_file_reader_read()
Please feel free to make changes, as although I did try to emulate the coding style of the rest of the avro c library, there may be things I've done "differently" :-)
Code is available from Github: https://github.com/hitwise/avro (branch: codec-deflate)
was:
We (Experian Hitwise) have added codec support to avro-c (as per the avro spec), with preliminary deflate/inflate support (as well as null codec support).
This changes the way blocks are written to the file, with the block data being passed through the codec interface, before being written to file.
This also changes the way blocks are read from a file, with the block data first being read into a buffer, before being passed through the codec interface, then a memory reader is set to the decoded data, which is read by the user calls avro_file_reader_read_value() and avro_file_reader_read()
Please feel free to make changes, as although I did try to emulate the coding style of the rest of the avro c library, there may be things I've done "differently" :-)
- Lucas
> Added Codec Support to Avro-C
> -----------------------------
>
> Key: AVRO-957
> URL: https://issues.apache.org/jira/browse/AVRO-957
> Project: Avro
> Issue Type: New Feature
> Components: c
> Reporter: Lucas Martin-King
> Labels: codec, deflate
>
> We (Experian Hitwise) have added codec support to avro-c (as per the avro spec), with preliminary deflate/inflate support (as well as null codec support).
> This changes the way blocks are written to the file, with the block data being passed through the codec interface, before being written to file.
> This also changes the way blocks are read from a file, with the block data first being read into a buffer, before being passed through the codec interface, then a memory reader is set to the decoded data, which is read by the user calls avro_file_reader_read_value() and avro_file_reader_read()
> Please feel free to make changes, as although I did try to emulate the coding style of the rest of the avro c library, there may be things I've done "differently" :-)
> Code is available from Github: https://github.com/hitwise/avro (branch: codec-deflate)
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira