You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@arrow.apache.org by "ASF GitHub Bot (JIRA)" <ji...@apache.org> on 2017/11/21 23:44:00 UTC

[jira] [Commented] (ARROW-1782) [Python] Expose compressors as pyarrow.compress, pyarrow.decompress

    [ https://issues.apache.org/jira/browse/ARROW-1782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16261684#comment-16261684 ] 

ASF GitHub Bot commented on ARROW-1782:
---------------------------------------

wesm opened a new pull request #1345: ARROW-1782: [Python] Add pyarrow.compress, decompress APIs
URL: https://github.com/apache/arrow/pull/1345
 
 
   This enables bytes, Buffer, or buffer-like objects to be compressed either to PyBytes or `pyarrow.Buffer`. Wanted some feedback on the API (argument names, etc.). The compression API in Arrow in general requires knowing the size of the decompressed data, but some compressors (like Snappy) are able to tell you how big the result will be based only on the input buffer

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


> [Python] Expose compressors as pyarrow.compress, pyarrow.decompress
> -------------------------------------------------------------------
>
>                 Key: ARROW-1782
>                 URL: https://issues.apache.org/jira/browse/ARROW-1782
>             Project: Apache Arrow
>          Issue Type: New Feature
>          Components: Python
>            Reporter: Wes McKinney
>            Assignee: Wes McKinney
>              Labels: pull-request-available
>             Fix For: 0.8.0
>
>
> These should release the GIL, and serve as an alternative to the various compressor wrapper libraries out there. They should have the ability to work with {{pyarrow.Buffer}} or {{PyBytes}} as the user prefers



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)