You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@arrow.apache.org by "Krisztian Szucs (Jira)" <ji...@apache.org> on 2020/09/23 15:29:00 UTC

[jira] [Updated] (ARROW-2045) [C++][Plasma] More primitive operations on plasma store

     [ https://issues.apache.org/jira/browse/ARROW-2045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Krisztian Szucs updated ARROW-2045:
-----------------------------------
    Fix Version/s:     (was: 2.0.0)
                   3.0.0

> [C++][Plasma] More primitive operations on plasma store
> -------------------------------------------------------
>
>                 Key: ARROW-2045
>                 URL: https://issues.apache.org/jira/browse/ARROW-2045
>             Project: Apache Arrow
>          Issue Type: New Feature
>          Components: C++ - Plasma
>            Reporter: Yuxin Wu
>            Priority: Minor
>             Fix For: 3.0.0
>
>
> Hi Developers,
> I found plasma store very useful – it's fast and simple to use. However, I think there are more operations that can make it a more general IPC/messaging tool and potentially helpful in more scenarios.
> Conceptually, an object store can support the following "put" methods:
>  # Evict when full
>  # Wait for space when full, perhaps with a timeout (i.e. blocking)
>  # Return failure when full (i.e. non-blocking)
> And the following "get" methods:
>  # Wait for the object to appear (i.e. blocking)
>  # Return failure when object doesn't exist (i.e. non-blocking)
>  # Remove the object after get
> Some of the above features can be implemented with others. But some of them are primitives (e.g. return failure when full) that needs to be supported.
>  
> My use case: I wanted to use plasma to send/recv large buffers between processes, i.e. build a message passing interface on top of shared memory. Plasma has made it quite easy (only have to send/recv the id) and efficient (faster than unix pipe). But "evict when full" is now the only available "put" method, so that could create many trouble if I want to ensure message delivery.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)