You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@arrow.apache.org by "He Kaisheng (JIRA)" <ji...@apache.org> on 2018/08/01 11:48:00 UTC
[jira] [Created] (ARROW-2956) Arrow plasma throws ArrowIOError:
Encountered unexpected EOF
He Kaisheng created ARROW-2956:
----------------------------------
Summary: Arrow plasma throws ArrowIOError: Encountered unexpected EOF
Key: ARROW-2956
URL: https://issues.apache.org/jira/browse/ARROW-2956
Project: Apache Arrow
Issue Type: Bug
Components: Python
Reporter: He Kaisheng
hello,
We start a plasma store with 100k memory. when storage is full, it throws ArrowIOError, not the expected PlasmaStoreFull error.
code:
{code:java}
import pyarrow.plasma as plasma
import numpy as np
plasma_client = plasma.connect(plasma_socket, '', 0)
ref = []
for _ in range(1000):
obj_id = plasma_client.put(np.random.randint(100, size=(100, 100),
dtype=np.int16))
data = plasma_client.get(obj_id)
ref.append(data)
{code}
error:
{noformat}
---------------------------------------------------------------------------
ArrowIOError Traceback (most recent call last)
<ipython-input-2-07ec7f6f4b82> in <module>()
2 ref = []
3 for _ in range(1000):
----> 4 obj_id = plasma_client.put(np.random.randint(100, size=(100, 100), dtype=np.int16))
5 data = plasma_client.get(obj_id)
6 ref.append(data)
plasma.pyx in pyarrow.plasma.PlasmaClient.put()
plasma.pyx in pyarrow.plasma.PlasmaClient.create()
error.pxi in pyarrow.lib.check_status()
ArrowIOError: Encountered unexpected EOF{noformat}
this problem doesn't exist when dtype is np.int64 or share memory is larger(like more than 100M), it seems so strange, anybody knows the reason? Thanks a lot.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)