You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@avro.apache.org by "Lucas Martin-King (JIRA)" <ji...@apache.org> on 2011/09/23 06:11:26 UTC

[jira] [Updated] (AVRO-893) New datum_t API does not write out spec compatible files - header, metadata and blocks are missing.

     [ https://issues.apache.org/jira/browse/AVRO-893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Lucas Martin-King updated AVRO-893:
-----------------------------------

    Description: 
We have switched over to the new datum_t API for our application, as it provides more AVRO types that we need (enum, array, etc), however we have noticed that there isn't a way to write out a spec compatible AVRO file.

The old API was able to write out a header as well as the schema, the finally each data block (and sync marker).

I could possibly try and re-implement this myself, however I am unsure as to the design (how it would fit into the new datum API).

  was:
We have switched over to the new datum_t API for our application, as it provides more AVRO types that we need (enum, array, etc), however we have noticed that there isn't a way to write out a spec compatible AVRO file.

The old API was able to write out a header as well as the schema, the finally each data block.

I could possibly try and re-implement this myself, however I am unsure as to the design (how it would fit into the new datum API).


> New datum_t API does not write out spec compatible files - header, metadata and blocks are missing.
> ---------------------------------------------------------------------------------------------------
>
>                 Key: AVRO-893
>                 URL: https://issues.apache.org/jira/browse/AVRO-893
>             Project: Avro
>          Issue Type: Improvement
>          Components: c
>    Affects Versions: 1.5.4
>         Environment: N/A
>            Reporter: Lucas Martin-King
>              Labels: file
>   Original Estimate: 24h
>  Remaining Estimate: 24h
>
> We have switched over to the new datum_t API for our application, as it provides more AVRO types that we need (enum, array, etc), however we have noticed that there isn't a way to write out a spec compatible AVRO file.
> The old API was able to write out a header as well as the schema, the finally each data block (and sync marker).
> I could possibly try and re-implement this myself, however I am unsure as to the design (how it would fit into the new datum API).

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira