You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@arrow.apache.org by "Zhijun Fu (JIRA)" <ji...@apache.org> on 2019/02/28 06:39:00 UTC
[jira] [Created] (ARROW-4711) [Plasma] enhance plasma client
interfaces to work with multiple objects
Zhijun Fu created ARROW-4711:
--------------------------------
Summary: [Plasma] enhance plasma client interfaces to work with multiple objects
Key: ARROW-4711
URL: https://issues.apache.org/jira/browse/ARROW-4711
Project: Apache Arrow
Issue Type: Improvement
Components: C++ - Plasma
Reporter: Zhijun Fu
Right now the Delete() interface in plasma client supports deleting multiple objects in a single shot, so that we can save IPCs (inter-processing communication) between plasma clients and plasma store. This reduces latency for plasma clients, and also improve the actual throughput for plasma store.
I made a simple prototype for changing Release() function as well, when batching release 10 objects in a single IPC, it only takes about 1/6 of the time compared with using 10 separate IPCs. Also from profiling, processing IPCs takes a lot of CPU cycles in plasma store currently, as UNIX domain socket processing needs to go through kernel, thus batching multiple IPCs into a single one should greatly improve the plasma store performance as well.
This change mostly applies to Release(), Seal(), and Create() interfaces.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)