You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@avro.apache.org by "Philip Zeyliger (JIRA)" <ji...@apache.org> on 2010/01/29 20:16:34 UTC

[jira] Updated: (AVRO-386) Python implementation of compression

     [ https://issues.apache.org/jira/browse/AVRO-386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Philip Zeyliger updated AVRO-386:
---------------------------------

    Attachment: AVRO-386.patch.txt

Attaching patch.  Note that this implementation is using the AVRO-380 change as well.

I did a minor amount of manual compatibility checking like so:
{noformat}
gseq 300 | sed -e 's/^/"/' -e 's/$/"/' | java -jar ../java/build/avro-tools-1.2.0-dev.jar fromjson '"string"' -  --codec "deflate" > /tmp/z
PYTHONPATH=src:lib python src/avro/tool.py  dump - < /tmp/z
{noformat}
Which is to say I wrote a data file with 300 string entries and made sure they came out ok the other end.  I ended up adding a "tool.py" to drive this command-line utility; it's quite minimal.

Jeff/Sharad: this was my first time with the python API; nice job... wasn't hard to figure out at all.

> Python implementation of compression
> ------------------------------------
>
>                 Key: AVRO-386
>                 URL: https://issues.apache.org/jira/browse/AVRO-386
>             Project: Avro
>          Issue Type: Improvement
>          Components: python
>    Affects Versions: 1.3.0
>            Reporter: Philip Zeyliger
>            Assignee: Philip Zeyliger
>         Attachments: AVRO-386.patch.txt
>
>
> AVRO-135 introduced compression.  AVRO-368 changed some metadata keys.  The patch to follow adds this functionality to the python implementation.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.