You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@arrow.apache.org by "Wes McKinney (JIRA)" <ji...@apache.org> on 2017/03/29 14:01:41 UTC

[jira] [Created] (ARROW-730) [Format] Define Flatbuffers metadata for random-access compressed block memory format

Wes McKinney created ARROW-730:
----------------------------------

             Summary: [Format] Define Flatbuffers metadata for random-access compressed block memory format
                 Key: ARROW-730
                 URL: https://issues.apache.org/jira/browse/ARROW-730
             Project: Apache Arrow
          Issue Type: New Feature
          Components: Format
            Reporter: Wes McKinney


It would be useful to be able to create a compressed buffer stream as a series of fixed-size blocks, with metadata written at the footer of the stream, so that random access is possible.

{code}
compressed_block[0]
...
compressed_block[N-1]
compression metadata
metadata_size (int32)
{code}



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)