[jira] [Updated] (ARROW-9777) [Rust] Implement IPC changes to catch up to 1.0.0 format

["Neville Dipale (Jira)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/ARROW-9777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Neville Dipale updated ARROW-9777:
----------------------------------
    Fix Version/s:     (was: 3.0.0)

> [Rust] Implement IPC changes to catch up to 1.0.0 format
> --------------------------------------------------------
>
>                 Key: ARROW-9777
>                 URL: https://issues.apache.org/jira/browse/ARROW-9777
>             Project: Apache Arrow
>          Issue Type: Improvement
>          Components: Rust
>    Affects Versions: 1.0.0
>            Reporter: Neville Dipale
>            Assignee: Neville Dipale
>            Priority: Minor
>              Labels: pull-request-available
>          Time Spent: 2h 10m
>  Remaining Estimate: 0h
>
> There are a number of IPC changes and features which the Rust implementation has fallen behind on. It's effectively using the legacy format that was released in 0.14.x.
> Some that I encountered are:
>  * change padding from 4 bytes to 8 bytes (along with the padding algorithm)
>  * add an IPC writer option to support the legacy format and updated format
>  * add error handling for the different metadata versions, we should support v4+ so it's an oversight to not explicitly return errors if unsupported versions are read
> Some of the work already has Jiras open (e.g. body compression), I'll find them and mark them as related to this.
> I'm tight for spare time, but I'll try work on this before the next release (along with the Parquet writer)



--
This message was sent by Atlassian Jira
(v8.3.4#803005)