You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@arrow.apache.org by "Neal Richardson (JIRA)" <ji...@apache.org> on 2019/06/04 21:28:00 UTC

[jira] [Created] (ARROW-5510) [Format] Feather V2

Neal Richardson created ARROW-5510:
--------------------------------------

             Summary: [Format] Feather V2
                 Key: ARROW-5510
                 URL: https://issues.apache.org/jira/browse/ARROW-5510
             Project: Apache Arrow
          Issue Type: Improvement
          Components: Format
            Reporter: Neal Richardson
            Assignee: Wes McKinney
             Fix For: 0.14.0


The initial Feather file format is a minimal subset of the Arrow IPC format. It has a number of limitations (see [https://wesmckinney.com/blog/feather-arrow-future/]). 

We want to retain "feather" as the name of the on-disk representation of Arrow memory, so in order to support everything that Arrow supports, we need a "feather 2.0" format.

IIUC, defining the file format is "done" (dump the memory to disk). Remaining issues include upgrading "feather" readers and writers in all languages to support both feather 1.0 and feather 2.0. (e.g. https://issues.apache.org/jira/browse/ARROW-5501)



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)