You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@arrow.apache.org by "Jorge Leitão (Jira)" <ji...@apache.org> on 2020/12/16 13:53:00 UTC

[jira] [Assigned] (ARROW-9777) [Rust] Implement IPC changes to catch up to 1.0.0 format

     [ https://issues.apache.org/jira/browse/ARROW-9777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Jorge Leitão reassigned ARROW-9777:
-----------------------------------

    Assignee: Neville Dipale

> [Rust] Implement IPC changes to catch up to 1.0.0 format
> --------------------------------------------------------
>
>                 Key: ARROW-9777
>                 URL: https://issues.apache.org/jira/browse/ARROW-9777
>             Project: Apache Arrow
>          Issue Type: Improvement
>          Components: Rust
>    Affects Versions: 1.0.0
>            Reporter: Neville Dipale
>            Assignee: Neville Dipale
>            Priority: Blocker
>             Fix For: 3.0.0
>
>
> There are a number of IPC changes and features which the Rust implementation has fallen behind on. It's effectively using the legacy format that was released in 0.14.x.
> Some that I encountered are:
>  * change padding from 4 bytes to 8 bytes (along with the padding algorithm)
>  * add an IPC writer option to support the legacy format and updated format
>  * add error handling for the different metadata versions, we should support v4+ so it's an oversight to not explicitly return errors if unsupported versions are read
> Some of the work already has Jiras open (e.g. body compression), I'll find them and mark them as related to this.
> I'm tight for spare time, but I'll try work on this before the next release (along with the Parquet writer)



--
This message was sent by Atlassian Jira
(v8.3.4#803005)