You are viewing a plain text version of this content. The canonical link for it is here.

Posted to jira@arrow.apache.org by "Nick White (Jira)" <ji...@apache.org> on 2020/11/12 22:57:00 UTC

[jira] [Created] (ARROW-10573) Zero-Copy Pandas Dataframe Reads

Nick White created ARROW-10573:
----------------------------------

             Summary: Zero-Copy Pandas Dataframe Reads
                 Key: ARROW-10573
                 URL: https://issues.apache.org/jira/browse/ARROW-10573
             Project: Apache Arrow
          Issue Type: Improvement
          Components: Python
    Affects Versions: 2.0.0
            Reporter: Nick White
            Assignee: Nick White


Arrow should be able to expose an IPC message as a Pandas dataframe without copying the data. This involves fixing:
 * the alignment of the IPC message, so all columns of the same type are in contiguous buffers and so can be exposed as the 2D arrays Pandas' block manager expects.
 * the `arrow_to_pandas.cc` code to make the UX work transparently.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)