You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@arrow.apache.org by "Mitar (JIRA)" <ji...@apache.org> on 2018/10/02 06:36:00 UTC

[jira] [Commented] (ARROW-3399) Cannot serialize numpy matrix object

    [ https://issues.apache.org/jira/browse/ARROW-3399?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16635077#comment-16635077 ] 

Mitar commented on ARROW-3399:
------------------------------

Oh, the difference is not between Arrow 0.9.0 and 0.10.0 but between numpy 1.14.3 and 1.15.2. Upgrading numpy to latest version throws the error above, while it works on an older version.

> Cannot serialize numpy matrix object
> ------------------------------------
>
>                 Key: ARROW-3399
>                 URL: https://issues.apache.org/jira/browse/ARROW-3399
>             Project: Apache Arrow
>          Issue Type: Bug
>    Affects Versions: 0.10.0
>            Reporter: Mitar
>            Priority: Major
>
> This is a regression from 0.9.0 and happens with 0.10.0 with Python 3.6.5 on Linux.
> {code:java}
> from pyarrow import plasma
> import numpy
> import time
> import subprocess
> import os
> import signal
> m = numpy.matrix(numpy.array([[1, 2], [3, 4]]))
> process = subprocess.Popen(['plasma_store', '-m', '1000000', '-s', '/tmp/plasma', '-d', '/dev/shm'], stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, encoding='utf8', preexec_fn=os.setpgrp)
> time.sleep(5)
> client = plasma.connect('/tmp/plasma', '', 0)
> try:
>     client.put(m)
> finally:
>     client.disconnect()
>     os.killpg(os.getpgid(process.pid), signal.SIGTERM)
> {code}
> Error:
> {noformat}
>   File "pyarrow/_plasma.pyx", line 397, in pyarrow._plasma.PlasmaClient.put
>   File "pyarrow/serialization.pxi", line 338, in pyarrow.lib.serialize
>   File "pyarrow/error.pxi", line 89, in pyarrow.lib.check_status
> pyarrow.lib.ArrowNotImplementedError: This object exceeds the maximum recursion depth. It may contain itself recursively.{noformat}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)