You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@arrow.apache.org by "Wes McKinney (JIRA)" <ji...@apache.org> on 2018/10/22 22:05:00 UTC
[jira] [Commented] (ARROW-3587) Efficient serialization for Arrow
Objects (array, table, tensor, etc)
[ https://issues.apache.org/jira/browse/ARROW-3587?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16659749#comment-16659749 ]
Wes McKinney commented on ARROW-3587:
-------------------------------------
No objections from me. The kinds of objects supported by {{pyarrow.serialize}} as you see are quite limited at the moment
> Efficient serialization for Arrow Objects (array, table, tensor, etc)
> ---------------------------------------------------------------------
>
> Key: ARROW-3587
> URL: https://issues.apache.org/jira/browse/ARROW-3587
> Project: Apache Arrow
> Issue Type: Improvement
> Components: C++, Plasma (C++), Python
> Reporter: Siyuan Zhuang
> Priority: Major
>
> Currently, Arrow seems to have poor serialization support for its own objects.
> For example,
>
> {code}
> import pyarrow
> arr = pyarrow.array([1, 2, 3, 4])
> pyarrow.serialize(arr)
> {code}
> Traceback (most recent call last):
> File "<stdin>", line 1, in <module>
> File "pyarrow/serialization.pxi", line 337, in pyarrow.lib.serialize
> File "pyarrow/serialization.pxi", line 136, in pyarrow.lib.SerializationContext._serialize_callback
> pyarrow.lib.SerializationCallbackError: pyarrow does not know how to serialize objects of type <class 'pyarrow.lib.Int64Array'>.
> I am working Ray & modin project, using plasma to store Arrow objects. Lack of direct serialization support harms the performance, so I would like to push a PR to fix this problem.
> I wonder if it is welcome or is there someone else doing it?
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)