You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@avro.apache.org by "Grant Rodgers (JIRA)" <ji...@apache.org> on 2010/05/27 20:02:41 UTC

[jira] Updated: (AVRO-554) data files created by ruby DataWriter are extremely large

     [ https://issues.apache.org/jira/browse/AVRO-554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Grant Rodgers updated AVRO-554:
-------------------------------

    Attachment: avro_comp.rb
                data10.avr
                data100.avr

Attached a ruby script demonstrating the issue. Run it by executing 'ruby avro_comp.rb 10000' (after installing the avro rubygem)

Also attached two data files produced by the above script with 10 and 100 records.

> data files created by ruby DataWriter are extremely large
> ---------------------------------------------------------
>
>                 Key: AVRO-554
>                 URL: https://issues.apache.org/jira/browse/AVRO-554
>             Project: Avro
>          Issue Type: Bug
>    Affects Versions: 1.3.0, 1.4.0
>         Environment: avro-1.4.0-pre1, ruby 1.8.7 (2010-01-10 patchlevel 249) [x86_64-linux]
>            Reporter: Grant Rodgers
>         Attachments: avro_comp.rb, data10.avr, data100.avr
>
>
> Adding 10000 records of a very simple schema (3 fields) to a DataWriter results in a file that is 317mb.  The same records in JSON are 430k.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.