[jira] [Commented] (ARROW-452) [C++/Python] Merge "Feather" file format implementation

["Wes McKinney (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/ARROW-452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15889311#comment-15889311 ] 

Wes McKinney commented on ARROW-452:
------------------------------------

For anyone who's wondering, the things that were prerequisites to do this were:

* Dictionary support in file format (aka Categorical or Factor types)
* 64-bit array lengths in memory

After addressing packaging and build issues for the R and Python communities, the goal will be to transition Feather users to use the Arrow file format internally (which is a much more general and flexible version of Feather) and then deprecate and remove the Feather implementation. Since we've made no guarantees of file forward compatibility this should be OK. 

> [C++/Python] Merge "Feather" file format implementation
> -------------------------------------------------------
>
>                 Key: ARROW-452
>                 URL: https://issues.apache.org/jira/browse/ARROW-452
>             Project: Apache Arrow
>          Issue Type: New Feature
>          Components: C++, Python
>            Reporter: Wes McKinney
>            Assignee: Wes McKinney
>
> See https://github.com/wesm/feather/tree/master/cpp -- this will assist with code consolidation and reconciling metadata requirements for Python and R users, with the goal of eventually using the Arrow IPC format for everything and deprecating the less-flexible Feather format / metadata. 



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)