You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@arrow.apache.org by "Robert Nishihara (JIRA)" <ji...@apache.org> on 2018/10/18 01:25:00 UTC

[jira] [Created] (ARROW-3548) Speed up storing small objects in the object store.

Robert Nishihara created ARROW-3548:
---------------------------------------

             Summary: Speed up storing small objects in the object store.
                 Key: ARROW-3548
                 URL: https://issues.apache.org/jira/browse/ARROW-3548
             Project: Apache Arrow
          Issue Type: Bug
          Components: Plasma (C++)
            Reporter: Robert Nishihara
            Assignee: Robert Nishihara


Currently, to store an object in the plasma object store, there are a lot of IPCs. We first call "Create", which does an IPC round trip. Then we call "Seal", which is one IPC. Then we call "Release", which is another IPC.

For small objects, we can just inline the object and metadata directly into the message to the store, and wait for the response (the response tells us if the object was successfully created). This is just a single IPC round trip, which can be much faster.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)