You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@avro.apache.org by "Philip Zeyliger (JIRA)" <ji...@apache.org> on 2010/01/29 20:16:34 UTC
[jira] Updated: (AVRO-386) Python implementation of compression
[ https://issues.apache.org/jira/browse/AVRO-386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Philip Zeyliger updated AVRO-386:
---------------------------------
Attachment: AVRO-386.patch.txt
Attaching patch. Note that this implementation is using the AVRO-380 change as well.
I did a minor amount of manual compatibility checking like so:
{noformat}
gseq 300 | sed -e 's/^/"/' -e 's/$/"/' | java -jar ../java/build/avro-tools-1.2.0-dev.jar fromjson '"string"' - --codec "deflate" > /tmp/z
PYTHONPATH=src:lib python src/avro/tool.py dump - < /tmp/z
{noformat}
Which is to say I wrote a data file with 300 string entries and made sure they came out ok the other end. I ended up adding a "tool.py" to drive this command-line utility; it's quite minimal.
Jeff/Sharad: this was my first time with the python API; nice job... wasn't hard to figure out at all.
> Python implementation of compression
> ------------------------------------
>
> Key: AVRO-386
> URL: https://issues.apache.org/jira/browse/AVRO-386
> Project: Avro
> Issue Type: Improvement
> Components: python
> Affects Versions: 1.3.0
> Reporter: Philip Zeyliger
> Assignee: Philip Zeyliger
> Attachments: AVRO-386.patch.txt
>
>
> AVRO-135 introduced compression. AVRO-368 changed some metadata keys. The patch to follow adds this functionality to the python implementation.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.