You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@arrow.apache.org by "Joris Van den Bossche (JIRA)" <ji...@apache.org> on 2019/08/02 14:49:04 UTC
[jira] [Comment Edited] (ARROW-5610) [Python] Define extension type
API in Python to "receive" or "send" a foreign extension type
[ https://issues.apache.org/jira/browse/ARROW-5610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16898927#comment-16898927 ]
Joris Van den Bossche edited comment on ARROW-5610 at 8/2/19 2:48 PM:
----------------------------------------------------------------------
{quote}I'll try to take a pass this week, if time permits; we would like this functionality{quote}
[~lidavidm] Did you further look at this?
{quote}
By the way, is there a Jira explicitly for being able to hook into to_pandas, or a suggested way to efficiently do a custom Pandas conversion?)
{quote}
There is ARROW-2428 for this about a hook into {{to_pandas}} to specify a custom conversion (there is also ARROW-5271 for the other way around: be able to specify the final arrow array in pandas -> arrow conversion).
was (Author: jorisvandenbossche):
{quote}I'll try to take a pass this week, if time permits; we would like this functionality{quote}
Did you further look at this?
{quote}
By the way, is there a Jira explicitly for being able to hook into to_pandas, or a suggested way to efficiently do a custom Pandas conversion?)
{quote}
There is ARROW-2428 for this about a hook into {{to_pandas}} to specify a custom conversion (there is also ARROW-5271 for the other way around: be able to specify the final arrow array in pandas -> arrow conversion).
> [Python] Define extension type API in Python to "receive" or "send" a foreign extension type
> --------------------------------------------------------------------------------------------
>
> Key: ARROW-5610
> URL: https://issues.apache.org/jira/browse/ARROW-5610
> Project: Apache Arrow
> Issue Type: Improvement
> Components: Python
> Reporter: Wes McKinney
> Priority: Major
> Fix For: 1.0.0
>
>
> In work in ARROW-840, a static {{arrow.py_extension_type}} name is used. There will be cases where an extension type is coming from another programming language (e.g. Java), so it would be useful to be able to "plug in" a Python extension type subclass that will be used to deserialize the extension type coming over the wire. This has some different API requirements since the serialized representation of the type will not have knowledge of Python pickling, etc.
--
This message was sent by Atlassian JIRA
(v7.6.14#76016)