You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@arrow.apache.org by "Wes McKinney (JIRA)" <ji...@apache.org> on 2016/07/11 00:41:11 UTC

[jira] [Commented] (ARROW-227) [C++/Python] Hook arrow_io generic reader / writer interface into arrow_parquet

    [ https://issues.apache.org/jira/browse/ARROW-227?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15370033#comment-15370033 ] 

Wes McKinney commented on ARROW-227:
------------------------------------

The scope of this JIRA is slightly larger than I originally thought, as we need to create Arrow-specialized implementations of parquet-cpp's abstract file and memory allocator interfaces (currently I think we are using the Parquet library's default allocator). I just started on this so just an FYI [~xhochy] 

> [C++/Python] Hook arrow_io generic reader / writer interface into arrow_parquet
> -------------------------------------------------------------------------------
>
>                 Key: ARROW-227
>                 URL: https://issues.apache.org/jira/browse/ARROW-227
>             Project: Apache Arrow
>          Issue Type: New Feature
>          Components: C++
>            Reporter: Wes McKinney
>            Assignee: Wes McKinney
>
> Now that ARROW-222 is merged, we can hook these together, and theoretically read and write to HDFS (or any other random access blob store). There's quite a bit of plumbing to do to make this work both in C++ and Python



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)