You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@arrow.apache.org by "Jorge Leitão (Jira)" <ji...@apache.org> on 2020/12/05 08:06:00 UTC

[jira] [Resolved] (ARROW-10109) [Rust] Add support to produce a C Data interface

     [ https://issues.apache.org/jira/browse/ARROW-10109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Jorge Leitão resolved ARROW-10109.
----------------------------------
    Resolution: Fixed

Issue resolved by pull request 8401
[https://github.com/apache/arrow/pull/8401]

> [Rust] Add support to produce a C Data interface
> ------------------------------------------------
>
>                 Key: ARROW-10109
>                 URL: https://issues.apache.org/jira/browse/ARROW-10109
>             Project: Apache Arrow
>          Issue Type: New Feature
>          Components: Rust
>            Reporter: Jorge Leitão
>            Assignee: Jorge Leitão
>            Priority: Major
>              Labels: pull-request-available
>             Fix For: 3.0.0
>
>          Time Spent: 8h 20m
>  Remaining Estimate: 0h
>
> The goal of this issue is to support producing C Data arrays of Rust.
> The use-case that motivated this issue was the possibility of running DataFusion from Python and support moving arrays from DataFusion to Python/Pyarray and vice-versa.
> In particular, so that users can write Python UDFs that expect arrow arrays and return arrow arrays, in the same spirit as pandas-udfs in Spark work for Pandas.
> The brute-force way of writing these arrays is by converting element by element from and to native types. The efficient way of doing it to pass the memory address from and to each implementation, which is zero-copy.
> To support the latter, we need an FFI implementation in Rust that produces and consumes [C's Data interface|https://arrow.apache.org/docs/format/CDataInterface.html]



--
This message was sent by Atlassian Jira
(v8.3.4#803005)