You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@arrow.apache.org by "Wes McKinney (Jira)" <ji...@apache.org> on 2021/02/19 21:04:00 UTC
[jira] [Closed] (ARROW-2956) [Python] Arrow plasma throws
ArrowIOError and process crashed
[ https://issues.apache.org/jira/browse/ARROW-2956?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Wes McKinney closed ARROW-2956.
-------------------------------
Resolution: Won't Fix
> [Python] Arrow plasma throws ArrowIOError and process crashed
> -------------------------------------------------------------
>
> Key: ARROW-2956
> URL: https://issues.apache.org/jira/browse/ARROW-2956
> Project: Apache Arrow
> Issue Type: Bug
> Components: Python
> Reporter: He Kaisheng
> Priority: Major
>
> hello,
> We start a plasma store with 100k memory. when storage is full, it throws ArrowIOError and the *process crashed,* not the expected PlasmaStoreFull error.
> code:
> {code:java}
> import pyarrow.plasma as plasma
> import numpy as np
> plasma_client = plasma.connect(plasma_socket, '', 0)
> ref = []
> for _ in range(1000):
> obj_id = plasma_client.put(np.random.randint(100, size=(100, 100), dtype=np.int16))
> data = plasma_client.get(obj_id)
> ref.append(data)
> {code}
> error:
> {noformat}
> ---------------------------------------------------------------------------
> ArrowIOError Traceback (most recent call last)
> <ipython-input-2-07ec7f6f4b82> in <module>()
> 2 ref = []
> 3 for _ in range(1000):
> ----> 4 obj_id = plasma_client.put(np.random.randint(100, size=(100, 100), dtype=np.int16))
> 5 data = plasma_client.get(obj_id)
> 6 ref.append(data)
> plasma.pyx in pyarrow.plasma.PlasmaClient.put()
> plasma.pyx in pyarrow.plasma.PlasmaClient.create()
> error.pxi in pyarrow.lib.check_status()
> ArrowIOError: Encountered unexpected EOF{noformat}
> this problem doesn't exist when dtype is np.int64 or share memory is larger(like more than 100M), it seems so strange, anybody knows the reason? Thanks a lot.
>
>
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)