You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@arrow.apache.org by "Krisztian Szucs (Jira)" <ji...@apache.org> on 2020/09/23 15:30:00 UTC
[jira] [Updated] (ARROW-4711) [Plasma] enhance plasma client
interfaces to work with multiple objects
[ https://issues.apache.org/jira/browse/ARROW-4711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Krisztian Szucs updated ARROW-4711:
-----------------------------------
Fix Version/s: (was: 2.0.0)
3.0.0
> [Plasma] enhance plasma client interfaces to work with multiple objects
> ------------------------------------------------------------------------
>
> Key: ARROW-4711
> URL: https://issues.apache.org/jira/browse/ARROW-4711
> Project: Apache Arrow
> Issue Type: Improvement
> Components: C++ - Plasma
> Reporter: Zhijun Fu
> Priority: Minor
> Fix For: 3.0.0
>
>
> Right now the Delete() interface in plasma client supports deleting multiple objects in a single shot, so that we can save IPCs (inter-processing communication) between plasma clients and plasma store. This reduces latency for plasma clients, and also improve the actual throughput for plasma store.
> I made a simple prototype for changing Release() function as well, when batching release 10 objects in a single IPC, it only takes about 1/6 of the time compared with using 10 separate IPCs. Also from profiling, processing IPCs takes a lot of CPU cycles in plasma store currently, as UNIX domain socket processing needs to go through kernel, thus batching multiple IPCs into a single one should greatly improve the plasma store performance as well.
>
> This change mostly applies to Release(), Seal(), and Create() interfaces.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)