You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@arrow.apache.org by "Antoine Pitrou (JIRA)" <ji...@apache.org> on 2019/06/03 12:35:00 UTC

[jira] [Updated] (ARROW-2953) [Plasma] Store memory usage

     [ https://issues.apache.org/jira/browse/ARROW-2953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Antoine Pitrou updated ARROW-2953:
----------------------------------
    Component/s: C++ - Plasma

> [Plasma] Store memory usage
> ---------------------------
>
>                 Key: ARROW-2953
>                 URL: https://issues.apache.org/jira/browse/ARROW-2953
>             Project: Apache Arrow
>          Issue Type: Improvement
>          Components: C++ - Plasma
>            Reporter: Philipp Moritz
>            Assignee: Philipp Moritz
>            Priority: Major
>              Labels: pull-request-available
>             Fix For: 0.10.0
>
>          Time Spent: 0.5h
>  Remaining Estimate: 0h
>
> While doing some memory profiling on the store, it became clear that at the moment the metadata of the objects takes up much more space than it should. In particular, for each object:
>  * The object id (20 bytes) is stored three times
>  * The object checksum (8 bytes) is stored twice
> We can therefore significantly reduce the metadata overhead with some refactoring.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)