You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@arrow.apache.org by "Wes McKinney (JIRA)" <ji...@apache.org> on 2019/07/12 17:58:00 UTC

[jira] [Updated] (ARROW-5931) [C++] Extend extension types facility to provide for serialization and deserialization in IPC roundtrips

     [ https://issues.apache.org/jira/browse/ARROW-5931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Wes McKinney updated ARROW-5931:
--------------------------------
    Description: 
A use case here is when an array needs to reference some external data. For example, suppose that we wanted to implement an array that references a sequence of Python objects as {{PyObject*}}. Obviously, a {{PyObject*}} must be managed by the Python interpreter.

For a vector of some {{T*}} to be sent through the IPC machinery, it must be embedded in some Arrow type on the wire. For example, the memory resident version of {{PyObject*}} might be 8-bytes per value (1 pointer per value) while being serialized to the binary IPC protocol, such {{PyObject*}} values must be serialized into an Arrow Binary type.

  was:
A use case here is when an array needs to reference some external data. For example, suppose that we wanted to implement an array that references a sequence of Python objects as {{PyObject**}}. Obviously, a {{PyObject*}} must be managed by the Python interpreter.

For a vector of some {{T*}} to be sent through the IPC machinery, it must be embedded in some Arrow type on the wire. For example, the memory resident version of {{PyObject**} might be 8-bytes per value (1 pointer per value) while being serialized to the binary IPC protocol, such {{PyObject*}} values must be serialized into an Arrow Binary type.




> [C++] Extend extension types facility to provide for serialization and deserialization in IPC roundtrips
> --------------------------------------------------------------------------------------------------------
>
>                 Key: ARROW-5931
>                 URL: https://issues.apache.org/jira/browse/ARROW-5931
>             Project: Apache Arrow
>          Issue Type: Improvement
>          Components: C++
>            Reporter: Wes McKinney
>            Priority: Major
>             Fix For: 1.0.0
>
>
> A use case here is when an array needs to reference some external data. For example, suppose that we wanted to implement an array that references a sequence of Python objects as {{PyObject*}}. Obviously, a {{PyObject*}} must be managed by the Python interpreter.
> For a vector of some {{T*}} to be sent through the IPC machinery, it must be embedded in some Arrow type on the wire. For example, the memory resident version of {{PyObject*}} might be 8-bytes per value (1 pointer per value) while being serialized to the binary IPC protocol, such {{PyObject*}} values must be serialized into an Arrow Binary type.



--
This message was sent by Atlassian JIRA
(v7.6.14#76016)