You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@avro.apache.org by "Joe Crobak (JIRA)" <ji...@apache.org> on 2011/07/28 21:48:09 UTC
[jira] [Created] (AVRO-866) Python: add snappy compression
Python: add snappy compression
------------------------------
Key: AVRO-866
URL: https://issues.apache.org/jira/browse/AVRO-866
Project: Avro
Issue Type: New Feature
Components: python
Reporter: Joe Crobak
Support for snappy compression was added to the Java implementation in AVRO-788. It would be great to add this to the python implementation -- there's already a library for python 2.5+: http://pypi.python.org/pypi/python-snappy
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (AVRO-866) Python: add snappy compression
Posted by "Doug Cutting (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/AVRO-866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13098469#comment-13098469 ]
Doug Cutting commented on AVRO-866:
-----------------------------------
Tom, this looks great! I'll commit it tomorrow unless someone objects.
> Python: add snappy compression
> ------------------------------
>
> Key: AVRO-866
> URL: https://issues.apache.org/jira/browse/AVRO-866
> Project: Avro
> Issue Type: New Feature
> Components: python
> Reporter: Joe Crobak
> Assignee: Tom White
> Fix For: 1.6.0
>
> Attachments: AVRO-866.patch, weather-snappy.avro
>
>
> Support for snappy compression was added to the Java implementation in AVRO-788. It would be great to add this to the python implementation -- there's already a library for python 2.5+: http://pypi.python.org/pypi/python-snappy
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (AVRO-866) Python: add snappy compression
Posted by "Tom White (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/AVRO-866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Tom White updated AVRO-866:
---------------------------
Attachment: weather-snappy.avro
AVRO-866.patch
Here's a patch for snappy support. I ran a test to check that an Avro data file produced using Python with the Snappy codec could be read from Java, and vice versa.
I've also attached weather-snappy.avro as an example of a snappy-compressed Avro data file, which might be worth checking into share/test/data.
> Python: add snappy compression
> ------------------------------
>
> Key: AVRO-866
> URL: https://issues.apache.org/jira/browse/AVRO-866
> Project: Avro
> Issue Type: New Feature
> Components: python
> Reporter: Joe Crobak
> Fix For: 1.6.0
>
> Attachments: AVRO-866.patch, weather-snappy.avro
>
>
> Support for snappy compression was added to the Java implementation in AVRO-788. It would be great to add this to the python implementation -- there's already a library for python 2.5+: http://pypi.python.org/pypi/python-snappy
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (AVRO-866) Python: add snappy compression
Posted by "Russell Jurney (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/AVRO-866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13169907#comment-13169907 ]
Russell Jurney commented on AVRO-866:
-------------------------------------
Note: python-snappy doesn't build on OS X 10.6.8, so avro won't build/install either.
> Python: add snappy compression
> ------------------------------
>
> Key: AVRO-866
> URL: https://issues.apache.org/jira/browse/AVRO-866
> Project: Avro
> Issue Type: New Feature
> Components: python
> Reporter: Joe Crobak
> Assignee: Tom White
> Fix For: 1.5.4
>
> Attachments: AVRO-866.patch, weather-snappy.avro
>
>
> Support for snappy compression was added to the Java implementation in AVRO-788. It would be great to add this to the python implementation -- there's already a library for python 2.5+: http://pypi.python.org/pypi/python-snappy
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (AVRO-866) Python: add snappy compression
Posted by "Tom White (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/AVRO-866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Tom White updated AVRO-866:
---------------------------
Status: Patch Available (was: Open)
> Python: add snappy compression
> ------------------------------
>
> Key: AVRO-866
> URL: https://issues.apache.org/jira/browse/AVRO-866
> Project: Avro
> Issue Type: New Feature
> Components: python
> Reporter: Joe Crobak
> Assignee: Tom White
> Fix For: 1.6.0
>
> Attachments: AVRO-866.patch, weather-snappy.avro
>
>
> Support for snappy compression was added to the Java implementation in AVRO-788. It would be great to add this to the python implementation -- there's already a library for python 2.5+: http://pypi.python.org/pypi/python-snappy
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Assigned] (AVRO-866) Python: add snappy compression
Posted by "Tom White (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/AVRO-866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Tom White reassigned AVRO-866:
------------------------------
Assignee: Tom White
> Python: add snappy compression
> ------------------------------
>
> Key: AVRO-866
> URL: https://issues.apache.org/jira/browse/AVRO-866
> Project: Avro
> Issue Type: New Feature
> Components: python
> Reporter: Joe Crobak
> Assignee: Tom White
> Fix For: 1.6.0
>
> Attachments: AVRO-866.patch, weather-snappy.avro
>
>
> Support for snappy compression was added to the Java implementation in AVRO-788. It would be great to add this to the python implementation -- there's already a library for python 2.5+: http://pypi.python.org/pypi/python-snappy
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (AVRO-866) Python: add snappy compression
Posted by "Doug Cutting (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/AVRO-866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Doug Cutting updated AVRO-866:
------------------------------
Resolution: Fixed
Fix Version/s: (was: 1.6.0)
1.5.4
Hadoop Flags: [Reviewed]
Status: Resolved (was: Patch Available)
I committed this. Thanks, Tom!
> Python: add snappy compression
> ------------------------------
>
> Key: AVRO-866
> URL: https://issues.apache.org/jira/browse/AVRO-866
> Project: Avro
> Issue Type: New Feature
> Components: python
> Reporter: Joe Crobak
> Assignee: Tom White
> Fix For: 1.5.4
>
> Attachments: AVRO-866.patch, weather-snappy.avro
>
>
> Support for snappy compression was added to the Java implementation in AVRO-788. It would be great to add this to the python implementation -- there's already a library for python 2.5+: http://pypi.python.org/pypi/python-snappy
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (AVRO-866) Python: add snappy compression
Posted by "Russell Jurney (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/AVRO-866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13169910#comment-13169910 ]
Russell Jurney commented on AVRO-866:
-------------------------------------
See AVRO-981
> Python: add snappy compression
> ------------------------------
>
> Key: AVRO-866
> URL: https://issues.apache.org/jira/browse/AVRO-866
> Project: Avro
> Issue Type: New Feature
> Components: python
> Reporter: Joe Crobak
> Assignee: Tom White
> Fix For: 1.5.4
>
> Attachments: AVRO-866.patch, weather-snappy.avro
>
>
> Support for snappy compression was added to the Java implementation in AVRO-788. It would be great to add this to the python implementation -- there's already a library for python 2.5+: http://pypi.python.org/pypi/python-snappy
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira