You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@avro.apache.org by "Grant Rodgers (JIRA)" <ji...@apache.org> on 2010/05/27 20:02:41 UTC
[jira] Updated: (AVRO-554) data files created by ruby DataWriter
are extremely large
[ https://issues.apache.org/jira/browse/AVRO-554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Grant Rodgers updated AVRO-554:
-------------------------------
Attachment: avro_comp.rb
data10.avr
data100.avr
Attached a ruby script demonstrating the issue. Run it by executing 'ruby avro_comp.rb 10000' (after installing the avro rubygem)
Also attached two data files produced by the above script with 10 and 100 records.
> data files created by ruby DataWriter are extremely large
> ---------------------------------------------------------
>
> Key: AVRO-554
> URL: https://issues.apache.org/jira/browse/AVRO-554
> Project: Avro
> Issue Type: Bug
> Affects Versions: 1.3.0, 1.4.0
> Environment: avro-1.4.0-pre1, ruby 1.8.7 (2010-01-10 patchlevel 249) [x86_64-linux]
> Reporter: Grant Rodgers
> Attachments: avro_comp.rb, data10.avr, data100.avr
>
>
> Adding 10000 records of a very simple schema (3 fields) to a DataWriter results in a file that is 317mb. The same records in JSON are 430k.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.