[jira] [Commented] (ARROW-4463) [Rust] Support read:write of Feather files

["Andy Grove (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/ARROW-4463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16759477#comment-16759477 ] 

Andy Grove commented on ARROW-4463:
-----------------------------------

Hi [~nevi_me] .. I went down this same path a while back ... Feather is an old format and not really supported now. It would be better to implement the IPC file format instead which is defined in [https://github.com/apache/arrow/blob/master/format/File.fbs]

 

Here is a PR where I had started work on this:

https://github.com/apache/arrow/pull/2986

 

> [Rust] Support read:write of Feather files
> ------------------------------------------
>
>                 Key: ARROW-4463
>                 URL: https://issues.apache.org/jira/browse/ARROW-4463
>             Project: Apache Arrow
>          Issue Type: New Feature
>          Components: Rust
>    Affects Versions: 0.12.0
>            Reporter: Neville Dipale
>            Priority: Major
>
> As an Arrow developer/user, I'd like to be able to read and write Feather files.
> The current I/O story in Rust isn't great, we don't yet fully support reading and writing between Parquet, we can only read CSV but not yet writing. This is an inconvenience (at least for me).
> I propose supporting the Feather format in Rust, initially with the following limitations:
>  * No date/time support until ARROW-4386 (and potentially more work) lands
>  * Reading categorical data (from other languages) but not writing them
>  * Reading and writing from and to single record batches. We don't yet support slicing of arrays ARROW-3954
> If the above are accept(ed|able), we can enhance the Feather support as the dependencies on the above limitations are lifted. 
> We can also refactor the Feather code as we work on more IPC in Rust.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)