You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@arrow.apache.org by "Antoine Pitrou (JIRA)" <ji...@apache.org> on 2019/06/04 13:52:00 UTC

[jira] [Commented] (ARROW-3877) [C++] Provide access to "maximum decompressed size" functions in compression libraries (if they exist)

    [ https://issues.apache.org/jira/browse/ARROW-3877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16855722#comment-16855722 ] 

Antoine Pitrou commented on ARROW-3877:
---------------------------------------

Do we have a use case currently for one-shot decompression without knowing the decompressed length?
Compressed files are read using streaming decompression (which is more reasonable for huge data anyway).

> [C++] Provide access to "maximum decompressed size" functions in compression libraries (if they exist)
> ------------------------------------------------------------------------------------------------------
>
>                 Key: ARROW-3877
>                 URL: https://issues.apache.org/jira/browse/ARROW-3877
>             Project: Apache Arrow
>          Issue Type: Improvement
>          Components: C++
>            Reporter: Wes McKinney
>            Priority: Major
>             Fix For: 0.14.0
>
>
> As follow up to ARROW-3831, some compression libraries have a function to provide a hint for sizing the output buffer (if it is not known already) for one-shot decompression. This would be helpful for sizing allocations in such cases



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)