You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@parquet.apache.org by "Wes McKinney (JIRA)" <ji...@apache.org> on 2016/05/05 04:37:12 UTC

[jira] [Resolved] (PARQUET-589) Implement Chunked InMemoryInputStream for better memory usage

     [ https://issues.apache.org/jira/browse/PARQUET-589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Wes McKinney resolved PARQUET-589.
----------------------------------
       Resolution: Fixed
    Fix Version/s: cpp-0.1

Issue resolved by pull request 89
[https://github.com/apache/parquet-cpp/pull/89]

> Implement Chunked InMemoryInputStream for better memory usage
> -------------------------------------------------------------
>
>                 Key: PARQUET-589
>                 URL: https://issues.apache.org/jira/browse/PARQUET-589
>             Project: Parquet
>          Issue Type: Improvement
>          Components: parquet-cpp
>            Reporter: Deepak Majeti
>            Assignee: Deepak Majeti
>             Fix For: cpp-0.1
>
>
> Parquet-cpp when creating a Column Reader, reads the entire source into a buffer, which is then passed to the InMemoryInputStream. This prohibits reading multiple large parquet files simultaneously. The scope of this JIRA is to implement an InputStream that does not  require the entire source to be read.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)