You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@arrow.apache.org by "lidavidm (JIRA)" <ji...@apache.org> on 2019/07/10 12:18:00 UTC

[jira] [Comment Edited] (ARROW-5610) [Python] Define extension type API in Python to "receive" or "send" a foreign extension type

    [ https://issues.apache.org/jira/browse/ARROW-5610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16881990#comment-16881990 ] 

lidavidm edited comment on ARROW-5610 at 7/10/19 12:17 PM:
-----------------------------------------------------------

Right now, if you define an extension type in Java whose type name is not "arrow.py_extension_type", you have no way of writing the Python equivalent. I think what's needed is a C++ extension type whose implementation dispatches to Python callbacks, which can be instantiated and registered with an arbitrary name. Basically, what Joris suggests with the extension type that can be parameterized with a name.


was (Author: lidavidm):
Right now, if you define an extension type in Java whose type name is not "arrow.py_extension_type", you have no way of writing the Python equivalent. I think what's needed is a C++ extension type whose implementation dispatches to Python callbacks, which can be instantiated and registered with an arbitrary name.

> [Python] Define extension type API in Python to "receive" or "send" a foreign extension type
> --------------------------------------------------------------------------------------------
>
>                 Key: ARROW-5610
>                 URL: https://issues.apache.org/jira/browse/ARROW-5610
>             Project: Apache Arrow
>          Issue Type: Improvement
>          Components: Python
>            Reporter: Wes McKinney
>            Priority: Major
>             Fix For: 1.0.0
>
>
> In work in ARROW-840, a static {{arrow.py_extension_type}} name is used. There will be cases where an extension type is coming from another programming language (e.g. Java), so it would be useful to be able to "plug in" a Python extension type subclass that will be used to deserialize the extension type coming over the wire. This has some different API requirements since the serialized representation of the type will not have knowledge of Python pickling, etc. 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)